2026-01-29 06:00:49 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-29 06:00:49 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-29 06:00:49 [auto1.it] INFO: Starting spider auto1.it
2026-01-29 06:00:49 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-29 06:00:49 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-29 06:00:49 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-29 06:00:49 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-29 06:00:49 [scrapy.extensions.telnet] INFO: Telnet Password: 67ac397a92981caa
2026-01-29 06:00:50 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-01-29 06:00:50 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_74_2026-01-29T06_00_03.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-01-29 06:00:50 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-29 06:00:50 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-29 06:00:50 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-29 06:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-29 06:00:50 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-29 06:00:50 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:50 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-29 06:00:50 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-29 06:00:50 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-29 06:00:50 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-29 06:00:50 [scrapy.core.engine] INFO: Spider opened
2026-01-29 06:00:50 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-29 06:00:50 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6030
2026-01-29 06:00:50 [scrapy-playwright] INFO: Starting download handler
2026-01-29 06:00:50 [scrapy-playwright] INFO: Starting download handler
2026-01-29 06:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-01-29 06:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-01-29 06:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-01-29 06:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-01-29 06:00:59 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:59 [auto1.it] INFO: Found listing with ID: VF92545
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2026-01-29 06:00:59 [auto1.it] INFO: Scrape type for VF92545: 0
2026-01-29 06:00:59 [auto1.it] INFO: Found listing with ID: GZ99689
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99689%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for GZ99689: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: EW36675
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for EW36675: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: WM74528
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM74528%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for WM74528: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: RY76570
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY76570%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for RY76570: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: PR91188
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for PR91188: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: YB92663
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for YB92663: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: BJ59156
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ59156%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for BJ59156: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: RX31393
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for RX31393: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: WR27841
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR27841%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for WR27841: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: NR29634
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR29634%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for NR29634: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: LU91869
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU91869%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for LU91869: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: LR57167
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR57167%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for LR57167: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: NF99707
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99707%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for NF99707: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: WA05631
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05631%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for WA05631: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: TR68531
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR68531%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for TR68531: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: LM12647
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for LM12647: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: HN05440
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN05440%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for HN05440: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: RR68985
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR68985%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for RR68985: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: JM33256
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM33256%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for JM33256: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: FM26794
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM26794%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for FM26794: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: MW66167
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW66167%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for MW66167: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: EA99584
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99584%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for EA99584: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: GN63531
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63531%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [auto1.it] INFO: Scrape type for GN63531: 0
2026-01-29 06:01:00 [auto1.it] INFO: Found listing with ID: AW68260
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW68260%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for AW68260: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: HE46295
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for HE46295: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: VT26842
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT26842%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for VT26842: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: DT01319
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT01319%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for DT01319: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: RD52267
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD52267%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for RD52267: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: ZG67214
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG67214%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for ZG67214: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: GD75064
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD75064%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for GD75064: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: TE33165
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE33165%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for TE33165: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: LM18187
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM18187%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for LM18187: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: JX24929
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX24929%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for JX24929: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: VP25370
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP25370%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for VP25370: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: DJ22210
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ22210%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for DJ22210: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: LN41021
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN41021%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for LN41021: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: AZ28034
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for AZ28034: 2
2026-01-29 06:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: TS13156
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS13156%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for TS13156: 0
2026-01-29 06:01:01 [auto1.it] INFO: Found listing with ID: CD79561
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [auto1.it] INFO: Scrape type for CD79561: 2
2026-01-29 06:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD79561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ28034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:02 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: VF92545
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for VF92545: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: GZ99689
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99689%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for GZ99689: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: EW36675
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for EW36675: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: WM74528
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM74528%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for WM74528: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: RY76570
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY76570%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for RY76570: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: PR91188
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for PR91188: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: YB92663
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for YB92663: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: BJ59156
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ59156%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [auto1.it] INFO: Scrape type for BJ59156: 0
2026-01-29 06:01:02 [auto1.it] INFO: Found listing with ID: RX31393
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for RX31393: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: WR27841
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR27841%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for WR27841: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: NR29634
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR29634%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for NR29634: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: LU91869
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU91869%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for LU91869: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: LR57167
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR57167%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for LR57167: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: NF99707
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99707%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for NF99707: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: WA05631
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05631%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for WA05631: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: TR68531
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR68531%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for TR68531: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: LM12647
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for LM12647: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: HN05440
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN05440%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for HN05440: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: RR68985
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR68985%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for RR68985: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: JM33256
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM33256%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for JM33256: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: FM26794
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM26794%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for FM26794: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: MW66167
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW66167%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for MW66167: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: EA99584
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99584%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for EA99584: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: GN63531
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63531%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for GN63531: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: AW68260
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW68260%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for AW68260: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: HE46295
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for HE46295: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: VT26842
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT26842%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for VT26842: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: DT01319
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT01319%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for DT01319: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: RD52267
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD52267%27 HTTP/1.1" 200 None
2026-01-29 06:01:03 [auto1.it] INFO: Scrape type for RD52267: 0
2026-01-29 06:01:03 [auto1.it] INFO: Found listing with ID: ZG67214
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG67214%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for ZG67214: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: GD75064
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD75064%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for GD75064: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: TE33165
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE33165%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for TE33165: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: LM18187
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM18187%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for LM18187: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: JX24929
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX24929%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for JX24929: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: VP25370
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP25370%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for VP25370: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: DJ22210
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ22210%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for DJ22210: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: LN41021
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN41021%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for LN41021: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: AZ28034
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for AZ28034: 2
2026-01-29 06:01:04 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/AZ28034/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-01-29 06:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: TS13156
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS13156%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for TS13156: 0
2026-01-29 06:01:04 [auto1.it] INFO: Found listing with ID: CD79561
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-29 06:01:04 [auto1.it] INFO: Scrape type for CD79561: 2
2026-01-29 06:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:05 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: FT64477
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT64477%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for FT64477: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: CA86340
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA86340%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for CA86340: 2
2026-01-29 06:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: UL25385
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL25385%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for UL25385: 2
2026-01-29 06:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: UP48367
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for UP48367: 2
2026-01-29 06:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: CE44712
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE44712%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for CE44712: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: AT20318
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for AT20318: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: HT61249
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT61249%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for HT61249: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: JE58021
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE58021%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for JE58021: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: XL30417
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL30417%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for XL30417: 2
2026-01-29 06:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: PP03591
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP03591%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for PP03591: 2
2026-01-29 06:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: LC41614
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC41614%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for LC41614: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: ZN59549
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN59549%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for ZN59549: 2
2026-01-29 06:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: GL50499
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL50499%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for GL50499: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: VT99729
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT99729%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for VT99729: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: RR79285
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR79285%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.it] INFO: Scrape type for RR79285: 0
2026-01-29 06:01:05 [auto1.it] INFO: Found listing with ID: HE18961
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE18961%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for HE18961: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: KE68041
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE68041%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for KE68041: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: SM84715
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM84715%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for SM84715: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: FU00657
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU00657%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for FU00657: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: AP06921
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP06921%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for AP06921: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: RU40979
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU40979%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for RU40979: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: FS37784
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS37784%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for FS37784: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: CV26562
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for CV26562: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: UU21154
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU21154%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for UU21154: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: FT86640
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT86640%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for FT86640: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: NV14879
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV14879%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for NV14879: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: EA57164
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA57164%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for EA57164: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: YC09499
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC09499%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for YC09499: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: SY04833
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY04833%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for SY04833: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: UY53299
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY53299%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for UY53299: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: XF61996
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF61996%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for XF61996: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: LS33015
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS33015%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for LS33015: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: NX59013
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX59013%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for NX59013: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: DA21697
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21697%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for DA21697: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: FG14287
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG14287%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for FG14287: 2
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: TT43912
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT43912%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for TT43912: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: KW99798
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW99798%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for KW99798: 0
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: VH97733
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH97733%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for VH97733: 2
2026-01-29 06:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL25385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: EN85352
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN85352%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for EN85352: 2
2026-01-29 06:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA86340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:06 [auto1.it] INFO: Found listing with ID: HF12865
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF12865%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [auto1.it] INFO: Scrape type for HF12865: 0
2026-01-29 06:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL30417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP03591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP48367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:07 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:07 [auto1.it] INFO: Found listing with ID: HM97674
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.it] INFO: Scrape type for HM97674: 0
2026-01-29 06:01:07 [auto1.it] INFO: Found listing with ID: DG14106
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG14106%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.it] INFO: Scrape type for DG14106: 0
2026-01-29 06:01:07 [auto1.it] INFO: Found listing with ID: GY89378
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY89378%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.it] INFO: Scrape type for GY89378: 2
2026-01-29 06:01:07 [auto1.it] INFO: Found listing with ID: FT66355
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT66355%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.it] INFO: Scrape type for FT66355: 2
2026-01-29 06:01:07 [auto1.it] INFO: Found listing with ID: UH26467
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH26467%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.it] INFO: Scrape type for UH26467: 0
2026-01-29 06:01:07 [auto1.it] INFO: Found listing with ID: EH01069
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH01069%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.it] INFO: Scrape type for EH01069: 2
2026-01-29 06:01:07 [auto1.it] INFO: Found listing with ID: SP36812
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP36812%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [auto1.it] INFO: Scrape type for SP36812: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: PW41874
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW41874%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for PW41874: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: ZB40645
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB40645%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for ZB40645: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: NB38092
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB38092%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for NB38092: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: HZ16886
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ16886%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for HZ16886: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: MG41952
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG41952%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for MG41952: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: GM98091
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM98091%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for GM98091: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: AL67393
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL67393%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for AL67393: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: TM67998
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM67998%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for TM67998: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: ZZ39119
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ39119%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for ZZ39119: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: EB83930
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB83930%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for EB83930: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: RZ37041
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ37041%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for RZ37041: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: YL53737
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for YL53737: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: LZ25760
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for LZ25760: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: RX14856
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX14856%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for RX14856: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: VJ83989
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ83989%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for VJ83989: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: RL06920
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for RL06920: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: DL90680
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL90680%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for DL90680: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: HP27763
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP27763%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for HP27763: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: JK71326
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK71326%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for JK71326: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: WR69312
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR69312%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for WR69312: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: LD57265
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for LD57265: 2
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: RD80125
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD80125%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for RD80125: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: LB68878
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB68878%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for LB68878: 2
2026-01-29 06:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU00657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU21154/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE68041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: JE72665
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE72665%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for JE72665: 2
2026-01-29 06:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN59549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV26562/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: BE02866
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE02866%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for BE02866: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: LC12522
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC12522%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for LC12522: 0
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: DE55553
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE55553%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for DE55553: 2
2026-01-29 06:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS37784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:08 [auto1.it] INFO: Found listing with ID: RN24419
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-01-29 06:01:08 [auto1.it] INFO: Scrape type for RN24419: 2
2026-01-29 06:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:09 [auto1.it] INFO: Found listing with ID: LA77465
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA77465%27 HTTP/1.1" 200 None
2026-01-29 06:01:09 [auto1.it] INFO: Scrape type for LA77465: 2
2026-01-29 06:01:09 [auto1.it] INFO: Found listing with ID: YM48404
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM48404%27 HTTP/1.1" 200 None
2026-01-29 06:01:09 [auto1.it] INFO: Scrape type for YM48404: 0
2026-01-29 06:01:09 [auto1.it] INFO: Found listing with ID: WT86652
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT86652%27 HTTP/1.1" 200 None
2026-01-29 06:01:09 [auto1.it] INFO: Scrape type for WT86652: 0
2026-01-29 06:01:09 [auto1.it] INFO: Found listing with ID: FA52335
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA52335%27 HTTP/1.1" 200 None
2026-01-29 06:01:09 [auto1.it] INFO: Scrape type for FA52335: 0
2026-01-29 06:01:09 [auto1.it] INFO: Found listing with ID: GX74312
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX74312%27 HTTP/1.1" 200 None
2026-01-29 06:01:09 [auto1.it] INFO: Scrape type for GX74312: 0
2026-01-29 06:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD79561> (referer: https://www.auto1.com/v1/car-details-view/CD79561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ28034> (referer: https://www.auto1.com/v1/car-details-view/AZ28034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561
2026-01-29 06:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c957701f-fda9-5198-a6ad-e712a85fa29c with scrape type 2
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c957701f-fda9-5198-a6ad-e712a85fa29c with scrape type 2
2026-01-29 06:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c957701f-fda9-5198-a6ad-e712a85fa29c, identifier: CD79561
2026-01-29 06:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-01-29 06:01:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-01-29 06:01:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561
2026-01-29 06:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561 to the API
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD79561>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2026-01-29T16:25:35Z',
'fuel_type': 'hybrid',
'id': 'c957701f-fda9-5198-a6ad-e712a85fa29c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD79561',
'listing': 'auction',
'location': 'IT, Rivalta di Torino (TO)',
'make': 'Peugeot',
'model': '3008',
'odometer': 70865,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
'transmission': 'automatic',
'trim': 'GT Pack',
'year': 2021}
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-29 06:01:12 [auto1.it] INFO: Saving data for CD79561: {'auction_closing_time': 1769703935.0, 'created_time': 1769458454.58264, 'last_price_update_time': 1769666472.296076}
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD79561') HTTP/1.1" 204 0
2026-01-29 06:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT86640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA21697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH97733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN85352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA57164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG14287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034
2026-01-29 06:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with scrape type 2
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with scrape type 2
2026-01-29 06:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a, identifier: AZ28034
2026-01-29 06:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034
2026-01-29 06:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034 to the API
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AZ28034>
{'auction_title': '',
'c_o_2_emission_value': 79,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 381,
'expiration_date': '2026-01-29T16:37:42Z',
'fuel_type': 'hybrid',
'id': '8c4f45f5-32d4-5eea-bb1f-99d9b721154a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ28034',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 127116,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid 80th Anniversary',
'transmission': 'automatic',
'trim': '80th Anniversary',
'year': 2021}
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [auto1.it] INFO: Saving data for AZ28034: {'auction_closing_time': 1769704662.0, 'created_time': 1769457775.822425, 'last_price_update_time': 1769666473.691112}
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AZ28034') HTTP/1.1" 204 0
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX59013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF61996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX14856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE55553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD57265/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL06920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB68878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS37784> (referer: https://www.auto1.com/v1/car-details-view/FS37784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE68041> (referer: https://www.auto1.com/v1/car-details-view/KE68041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV26562> (referer: https://www.auto1.com/v1/car-details-view/CV26562/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE72665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784
2026-01-29 06:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with scrape type 2
2026-01-29 06:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with scrape type 2
2026-01-29 06:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f, identifier: FS37784
2026-01-29 06:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-01-29 06:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-01-29 06:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784
2026-01-29 06:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784 to the API
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FS37784>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 86,
'expiration_date': '2026-01-29T16:01:55Z',
'fuel_type': 'petrol',
'id': 'c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS37784',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Ford',
'model': 'Ka+',
'odometer': 38982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ka+ 1.2 Ti-VCT Ultimate',
'transmission': 'manual',
'trim': 'Ultimate',
'year': 2019}
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS37784%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [auto1.it] INFO: Saving data for FS37784: {'auction_closing_time': 1769702515.0, 'created_time': 1768939297.803108, 'last_price_update_time': 1769666476.384354}
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FS37784') HTTP/1.1" 204 0
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU00657> (referer: https://www.auto1.com/v1/car-details-view/FU00657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA77465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN59549> (referer: https://www.auto1.com/v1/car-details-view/ZN59549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU21154> (referer: https://www.auto1.com/v1/car-details-view/UU21154/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 with identifier: KE68041
2026-01-29 06:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ea5b4e0-4825-523f-ae61-ef7650a22085 with scrape type 2
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ea5b4e0-4825-523f-ae61-ef7650a22085 with scrape type 2
2026-01-29 06:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ea5b4e0-4825-523f-ae61-ef7650a22085, identifier: KE68041
2026-01-29 06:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-01-29 06:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with scrape type 2
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with scrape type 2
2026-01-29 06:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b, identifier: CV26562
2026-01-29 06:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 with identifier: KE68041
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-01-29 06:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-01-29 06:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 with identifier: KE68041
2026-01-29 06:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165683 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165683
2026-01-29 06:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 spider: auto1.it
2026-01-29 06:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5ea5b4e0-4825-523f-ae61-ef7650a22085 due to rule: high_mileage_for_country.json, error: 165683 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165683
{'auction_title': '',
'c_o_2_emission_value': 233,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 249,
'expiration_date': '2026-01-29T16:39:13Z',
'fuel_type': 'diesel',
'id': '5ea5b4e0-4825-523f-ae61-ef7650a22085',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE68041',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 165683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport D250 Mild-Hybrid HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2021}
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE68041%27 HTTP/1.1" 200 None
2026-01-29 06:01:17 [auto1.it] INFO: Saving data for KE68041: {'auction_closing_time': 1769704753.0, 'created_time': 1768507253.750833, 'last_price_update_time': 1769666477.547313}
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE68041') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-01-29 06:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-01-29 06:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562 to the API
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CV26562>
{'auction_title': '',
'c_o_2_emission_value': 184,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-29T16:40:12Z',
'fuel_type': 'petrol',
'id': 'b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV26562',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 36904,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 40 TFSI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2022}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [auto1.it] INFO: Saving data for CV26562: {'auction_closing_time': 1769704812.0, 'created_time': 1768507255.173891, 'last_price_update_time': 1769666478.174639}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV26562') HTTP/1.1" 204 0
2026-01-29 06:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657
2026-01-29 06:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b199191a-2aae-5167-a745-f183d8bff009 with scrape type 2
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b199191a-2aae-5167-a745-f183d8bff009 with scrape type 2
2026-01-29 06:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b199191a-2aae-5167-a745-f183d8bff009, identifier: FU00657
2026-01-29 06:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549
2026-01-29 06:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with scrape type 2
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with scrape type 2
2026-01-29 06:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f, identifier: ZN59549
2026-01-29 06:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154
2026-01-29 06:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54718c8f-054a-50d3-b0db-3e149b768de4 with scrape type 2
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54718c8f-054a-50d3-b0db-3e149b768de4 with scrape type 2
2026-01-29 06:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54718c8f-054a-50d3-b0db-3e149b768de4, identifier: UU21154
2026-01-29 06:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657
2026-01-29 06:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657
2026-01-29 06:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657 to the API
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FU00657>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-01-29T16:38:52Z',
'fuel_type': 'diesel',
'id': 'b199191a-2aae-5167-a745-f183d8bff009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU00657',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'BMW',
'model': '5er',
'odometer': 103713,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2018}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU00657%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [auto1.it] INFO: Saving data for FU00657: {'auction_closing_time': 1769704732.0, 'created_time': 1767816353.381926, 'last_price_update_time': 1769666478.896917}
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU00657') HTTP/1.1" 204 0
2026-01-29 06:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549
2026-01-29 06:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549
2026-01-29 06:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549 to the API
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN59549>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 230,
'expiration_date': '2026-01-29T16:50:14Z',
'fuel_type': 'hybrid',
'id': '7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN59549',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 54498,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
'transmission': 'automatic',
'trim': 'XLine 2WD',
'year': 2023}
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN59549%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [auto1.it] INFO: Saving data for ZN59549: {'auction_closing_time': 1769705414.0, 'created_time': 1768594112.024027, 'last_price_update_time': 1769666479.33402}
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZN59549') HTTP/1.1" 204 0
2026-01-29 06:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154
2026-01-29 06:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154
2026-01-29 06:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154 to the API
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UU21154>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2026-01-29T16:23:50Z',
'fuel_type': 'hybrid',
'id': '54718c8f-054a-50d3-b0db-3e149b768de4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU21154',
'listing': 'auction',
'location': 'IT, Vercelli (VC)',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 118355,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid Grand Chic 4x4',
'transmission': 'automatic',
'trim': 'Grand Chic 4x4',
'year': 2020}
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU21154%27 HTTP/1.1" 200 None
2026-01-29 06:01:20 [auto1.it] INFO: Saving data for UU21154: {'auction_closing_time': 1769703830.0, 'created_time': 1769458477.423629, 'last_price_update_time': 1769666480.606343}
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU21154') HTTP/1.1" 204 0
2026-01-29 06:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN24419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG14287> (referer: https://www.auto1.com/v1/car-details-view/FG14287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA57164> (referer: https://www.auto1.com/v1/car-details-view/EA57164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX59013> (referer: https://www.auto1.com/v1/car-details-view/NX59013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with identifier: FG14287
2026-01-29 06:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with scrape type 2
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with scrape type 2
2026-01-29 06:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d, identifier: FG14287
2026-01-29 06:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164
2026-01-29 06:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bced772-4da2-571a-8621-4c4d204ea8db with scrape type 2
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bced772-4da2-571a-8621-4c4d204ea8db with scrape type 2
2026-01-29 06:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3bced772-4da2-571a-8621-4c4d204ea8db, identifier: EA57164
2026-01-29 06:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with identifier: FG14287
2026-01-29 06:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with identifier: FG14287
2026-01-29 06:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178986 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178986
2026-01-29 06:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d spider: auto1.it
2026-01-29 06:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d due to rule: high_mileage_for_country.json, error: 178986 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178986
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-01-29T16:27:58Z',
'fuel_type': 'diesel',
'id': '5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG14287',
'listing': 'auction',
'location': 'IT, Foggia',
'make': 'Volvo',
'model': 'XC60',
'odometer': 178986,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Plus Dark AWD',
'transmission': 'automatic',
'trim': 'Plus Dark AWD',
'year': 2023}
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG14287%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.it] INFO: Saving data for FG14287: {'auction_closing_time': 1769704078.0, 'created_time': 1769458279.69382, 'last_price_update_time': 1769666481.293799}
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FG14287') HTTP/1.1" 204 0
2026-01-29 06:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164
2026-01-29 06:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164
2026-01-29 06:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164 to the API
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA57164>
{'auction_title': '',
'c_o_2_emission_value': 161,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-01-29T16:18:55Z',
'fuel_type': 'diesel',
'id': '3bced772-4da2-571a-8621-4c4d204ea8db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA57164',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 135884,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Business',
'transmission': 'automatic',
'trim': '4Matic Business',
'year': 2019}
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA57164%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [auto1.it] INFO: Saving data for EA57164: {'auction_closing_time': 1769703535.0, 'created_time': 1768982479.042918, 'last_price_update_time': 1769666481.711519}
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA57164') HTTP/1.1" 204 0
2026-01-29 06:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013
2026-01-29 06:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bcaf00-9213-546a-ae02-9b13c8d6134c with scrape type 2
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26bcaf00-9213-546a-ae02-9b13c8d6134c with scrape type 2
2026-01-29 06:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26bcaf00-9213-546a-ae02-9b13c8d6134c, identifier: NX59013
2026-01-29 06:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013
2026-01-29 06:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013
2026-01-29 06:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013 to the API
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX59013>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:12:30Z',
'fuel_type': 'diesel',
'id': '26bcaf00-9213-546a-ae02-9b13c8d6134c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX59013',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 98192,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX59013%27 HTTP/1.1" 200 None
2026-01-29 06:01:22 [auto1.it] INFO: Saving data for NX59013: {'auction_closing_time': 1769703150.0, 'created_time': 1769025694.700034, 'last_price_update_time': 1769666482.245507}
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NX59013') HTTP/1.1" 204 0
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE55553> (referer: https://www.auto1.com/v1/car-details-view/DE55553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX14856> (referer: https://www.auto1.com/v1/car-details-view/RX14856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN85352> (referer: https://www.auto1.com/v1/car-details-view/EN85352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7082e32c-8d09-50d9-99f3-3009245eb214 with identifier: DE55553
2026-01-29 06:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7082e32c-8d09-50d9-99f3-3009245eb214 with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7082e32c-8d09-50d9-99f3-3009245eb214 with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7082e32c-8d09-50d9-99f3-3009245eb214, identifier: DE55553
2026-01-29 06:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856
2026-01-29 06:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a753834c-ca33-5285-afd8-0555dfc952b1 with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a753834c-ca33-5285-afd8-0555dfc952b1 with scrape type 2
2026-01-29 06:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a753834c-ca33-5285-afd8-0555dfc952b1, identifier: RX14856
2026-01-29 06:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7082e32c-8d09-50d9-99f3-3009245eb214 with identifier: DE55553
2026-01-29 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7082e32c-8d09-50d9-99f3-3009245eb214 with identifier: DE55553
2026-01-29 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174303 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174303
2026-01-29 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7082e32c-8d09-50d9-99f3-3009245eb214 spider: auto1.it
2026-01-29 06:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 7082e32c-8d09-50d9-99f3-3009245eb214 due to rule: high_mileage_for_country.json, error: 174303 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174303
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:30:23Z',
'fuel_type': 'diesel',
'id': '7082e32c-8d09-50d9-99f3-3009245eb214',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE55553',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Audi',
'model': 'Q3',
'odometer': 174303,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE55553%27 HTTP/1.1" 200 None
2026-01-29 06:01:22 [auto1.it] INFO: Saving data for DE55553: {'auction_closing_time': 1769704223.0, 'created_time': 1768593794.909514, 'last_price_update_time': 1769666482.853406}
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE55553') HTTP/1.1" 204 0
2026-01-29 06:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856
2026-01-29 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856
2026-01-29 06:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856 to the API
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX14856>
{'auction_title': '',
'c_o_2_emission_value': 18,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 326,
'expiration_date': '2026-01-29T16:33:25Z',
'fuel_type': 'hybrid',
'id': 'a753834c-ca33-5285-afd8-0555dfc952b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX14856',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'BMW',
'model': 'X1',
'odometer': 22466,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 30e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2024}
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX14856%27 HTTP/1.1" 200 None
2026-01-29 06:01:23 [auto1.it] INFO: Saving data for RX14856: {'auction_closing_time': 1769704405.0, 'created_time': 1769458449.295062, 'last_price_update_time': 1769666483.37653}
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX14856') HTTP/1.1" 204 0
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF61996> (referer: https://www.auto1.com/v1/car-details-view/XF61996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL06920> (referer: https://www.auto1.com/v1/car-details-view/RL06920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB68878> (referer: https://www.auto1.com/v1/car-details-view/LB68878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD57265> (referer: https://www.auto1.com/v1/car-details-view/LD57265/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352
2026-01-29 06:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f07141ec-2729-5808-b041-bc1279a3fe66 with scrape type 2
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f07141ec-2729-5808-b041-bc1279a3fe66 with scrape type 2
2026-01-29 06:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f07141ec-2729-5808-b041-bc1279a3fe66, identifier: EN85352
2026-01-29 06:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352
2026-01-29 06:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352
2026-01-29 06:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352 to the API
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN85352>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:08:45Z',
'fuel_type': 'diesel',
'id': 'f07141ec-2729-5808-b041-bc1279a3fe66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN85352',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 94633,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport D150 Mild-Hybrid Business AWD',
'transmission': 'automatic',
'trim': 'Business AWD',
'year': 2020}
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN85352%27 HTTP/1.1" 200 None
2026-01-29 06:01:23 [auto1.it] INFO: Saving data for EN85352: {'auction_closing_time': 1769702925.0, 'created_time': 1768471325.786649, 'last_price_update_time': 1769666483.907684}
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN85352') HTTP/1.1" 204 0
2026-01-29 06:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c60195-9a19-577b-b605-aabbccf394a1 with identifier: XF61996
2026-01-29 06:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c60195-9a19-577b-b605-aabbccf394a1 with scrape type 2
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c60195-9a19-577b-b605-aabbccf394a1 with scrape type 2
2026-01-29 06:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5c60195-9a19-577b-b605-aabbccf394a1, identifier: XF61996
2026-01-29 06:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-01-29 06:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6863c36a-1598-5ab6-9106-cdd312605390 with scrape type 2
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6863c36a-1598-5ab6-9106-cdd312605390 with scrape type 2
2026-01-29 06:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6863c36a-1598-5ab6-9106-cdd312605390, identifier: RL06920
2026-01-29 06:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878
2026-01-29 06:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with scrape type 2
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with scrape type 2
2026-01-29 06:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48, identifier: LB68878
2026-01-29 06:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-01-29 06:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with scrape type 2
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with scrape type 2
2026-01-29 06:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00bfeec1-6ca8-517a-8a76-c405df2aeb12, identifier: LD57265
2026-01-29 06:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5c60195-9a19-577b-b605-aabbccf394a1 with identifier: XF61996
2026-01-29 06:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5c60195-9a19-577b-b605-aabbccf394a1 with identifier: XF61996
2026-01-29 06:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-29 06:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c5c60195-9a19-577b-b605-aabbccf394a1 spider: auto1.it
2026-01-29 06:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c5c60195-9a19-577b-b605-aabbccf394a1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:19:02Z',
'fuel_type': 'petrol',
'id': 'c5c60195-9a19-577b-b605-aabbccf394a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF61996',
'listing': 'auction',
'location': 'IT, Casamassima',
'make': 'Opel',
'model': 'Combo',
'odometer': 105394,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-30',
'seats_number': 3,
'seller_name': None,
'title': 'Opel Combo 1.2 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2020}
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF61996%27 HTTP/1.1" 200 None
2026-01-29 06:01:24 [auto1.it] INFO: Saving data for XF61996: {'auction_closing_time': 1769703542.0, 'created_time': 1769458522.468753, 'last_price_update_time': 1769666484.758266}
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF61996') HTTP/1.1" 204 0
2026-01-29 06:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-01-29 06:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-01-29 06:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920 to the API
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL06920>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-01-29T16:38:50Z',
'fuel_type': 'petrol',
'id': '6863c36a-1598-5ab6-9106-cdd312605390',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL06920',
'listing': 'auction',
'location': 'Perugia',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 39627,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2022}
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-01-29 06:01:25 [auto1.it] INFO: Saving data for RL06920: {'auction_closing_time': 1769704730.0, 'created_time': 1769458189.474758, 'last_price_update_time': 1769666485.154263}
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL06920') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878
2026-01-29 06:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878
2026-01-29 06:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878 to the API
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LB68878>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-01-29T16:32:03Z',
'fuel_type': 'diesel',
'id': '5c1f0a8a-90db-5043-93d5-a4ea4fa78d48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB68878',
'listing': 'auction',
'location': 'Casoria',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 140693,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 2.0 CDTI Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2018}
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB68878%27 HTTP/1.1" 200 None
2026-01-29 06:01:25 [auto1.it] INFO: Saving data for LB68878: {'auction_closing_time': 1769704323.0, 'created_time': 1769457927.945014, 'last_price_update_time': 1769666485.544442}
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB68878') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-01-29 06:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-01-29 06:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265 to the API
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LD57265>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 116,
'expiration_date': '2026-01-29T16:32:03Z',
'fuel_type': 'diesel',
'id': '00bfeec1-6ca8-517a-8a76-c405df2aeb12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD57265',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 143043,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-25',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2021}
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-01-29 06:01:25 [auto1.it] INFO: Saving data for LD57265: {'auction_closing_time': 1769704323.0, 'created_time': 1769458240.256474, 'last_price_update_time': 1769666485.982278}
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD57265') HTTP/1.1" 204 0
2026-01-29 06:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT86640> (referer: https://www.auto1.com/v1/car-details-view/FT86640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ25760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA21697> (referer: https://www.auto1.com/v1/car-details-view/DA21697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 with identifier: FT86640
2026-01-29 06:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0840f43a-a728-5a1b-8836-0726c34f1ca3 with scrape type 2
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0840f43a-a728-5a1b-8836-0726c34f1ca3 with scrape type 2
2026-01-29 06:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0840f43a-a728-5a1b-8836-0726c34f1ca3, identifier: FT86640
2026-01-29 06:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 with identifier: FT86640
2026-01-29 06:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 with identifier: FT86640
2026-01-29 06:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154941 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154941
2026-01-29 06:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 spider: auto1.it
2026-01-29 06:01:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0840f43a-a728-5a1b-8836-0726c34f1ca3 due to rule: high_mileage_for_country.json, error: 154941 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154941
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-01-29T16:51:48Z',
'fuel_type': 'diesel',
'id': '0840f43a-a728-5a1b-8836-0726c34f1ca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT86640',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 154941,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.6 dCi Energy Hypnotic2',
'transmission': 'automatic',
'trim': 'Hypnotic2',
'year': 2018}
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT86640%27 HTTP/1.1" 200 None
2026-01-29 06:01:26 [auto1.it] INFO: Saving data for FT86640: {'auction_closing_time': 1769705508.0, 'created_time': 1768507450.314674, 'last_price_update_time': 1769666486.483112}
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT86640') HTTP/1.1" 204 0
2026-01-29 06:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH97733> (referer: https://www.auto1.com/v1/car-details-view/VH97733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697
2026-01-29 06:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42375cb1-8ae2-5920-8baa-7510090967c2 with scrape type 2
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42375cb1-8ae2-5920-8baa-7510090967c2 with scrape type 2
2026-01-29 06:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42375cb1-8ae2-5920-8baa-7510090967c2, identifier: DA21697
2026-01-29 06:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-01-29 06:01:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697
2026-01-29 06:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697 to the API
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA21697>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 114,
'expiration_date': '2026-01-29T16:04:33Z',
'fuel_type': 'gas',
'id': '42375cb1-8ae2-5920-8baa-7510090967c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA21697',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'DR',
'model': 'DR 5.0',
'odometer': 15661,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 5.0 1.5 LPG Unica',
'transmission': 'manual',
'trim': 'Unica',
'year': 2024}
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21697%27 HTTP/1.1" 200 None
2026-01-29 06:01:27 [auto1.it] INFO: Saving data for DA21697: {'auction_closing_time': 1769702673.0, 'created_time': 1769458599.68537, 'last_price_update_time': 1769666487.329565}
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA21697') HTTP/1.1" 204 0
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA77465> (referer: https://www.auto1.com/v1/car-details-view/LA77465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL53737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE72665> (referer: https://www.auto1.com/v1/car-details-view/JE72665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG41952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733
2026-01-29 06:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with scrape type 2
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with scrape type 2
2026-01-29 06:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb1bdb37-0f40-5444-8d30-20f1f3f9c845, identifier: VH97733
2026-01-29 06:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-01-29 06:01:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733
2026-01-29 06:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733 to the API
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH97733>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:49:31Z',
'fuel_type': 'diesel',
'id': 'bb1bdb37-0f40-5444-8d30-20f1f3f9c845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH97733',
'listing': 'auction',
'location': 'Modugno',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 123971,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Bose Edition',
'transmission': 'automatic',
'trim': 'Bose Edition',
'year': 2018}
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH97733%27 HTTP/1.1" 200 None
2026-01-29 06:01:27 [auto1.it] INFO: Saving data for VH97733: {'auction_closing_time': 1769705371.0, 'created_time': 1769458526.284145, 'last_price_update_time': 1769666487.977354}
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH97733') HTTP/1.1" 204 0
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN24419> (referer: https://www.auto1.com/v1/car-details-view/RN24419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB40645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465
2026-01-29 06:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18cb58d6-7632-5eda-88c1-cd2927e2523e with scrape type 2
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18cb58d6-7632-5eda-88c1-cd2927e2523e with scrape type 2
2026-01-29 06:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18cb58d6-7632-5eda-88c1-cd2927e2523e, identifier: LA77465
2026-01-29 06:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665
2026-01-29 06:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7412e6c5-65bb-5ff0-a488-bd6986290893 with scrape type 2
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7412e6c5-65bb-5ff0-a488-bd6986290893 with scrape type 2
2026-01-29 06:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7412e6c5-65bb-5ff0-a488-bd6986290893, identifier: JE72665
2026-01-29 06:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465
2026-01-29 06:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465
2026-01-29 06:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465 to the API
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA77465>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-01-29T16:54:32Z',
'fuel_type': 'diesel',
'id': '18cb58d6-7632-5eda-88c1-cd2927e2523e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA77465',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'BMW',
'model': 'X5',
'odometer': 113896,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA77465%27 HTTP/1.1" 200 None
2026-01-29 06:01:28 [auto1.it] INFO: Saving data for LA77465: {'auction_closing_time': 1769705672.0, 'created_time': 1768248453.843478, 'last_price_update_time': 1769666488.704442}
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA77465') HTTP/1.1" 204 0
2026-01-29 06:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665
2026-01-29 06:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665
2026-01-29 06:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665 to the API
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE72665>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:23:06Z',
'fuel_type': 'petrol',
'id': '7412e6c5-65bb-5ff0-a488-bd6986290893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE72665',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Seat',
'model': 'Arona',
'odometer': 84367,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.0 TSI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2019}
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE72665%27 HTTP/1.1" 200 None
2026-01-29 06:01:29 [auto1.it] INFO: Saving data for JE72665: {'auction_closing_time': 1769703786.0, 'created_time': 1768507498.190974, 'last_price_update_time': 1769666489.140252}
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE72665') HTTP/1.1" 204 0
2026-01-29 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP36812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH01069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-01-29 06:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 752208e0-483a-5ac1-b162-e4c16b7ab71c with scrape type 2
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 752208e0-483a-5ac1-b162-e4c16b7ab71c with scrape type 2
2026-01-29 06:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 752208e0-483a-5ac1-b162-e4c16b7ab71c, identifier: RN24419
2026-01-29 06:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-01-29 06:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-01-29 06:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419 to the API
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN24419>
{'auction_title': '',
'c_o_2_emission_value': 192,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 200,
'expiration_date': '2026-01-29T16:27:24Z',
'fuel_type': 'diesel',
'id': '752208e0-483a-5ac1-b162-e4c16b7ab71c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN24419',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 76562,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.2 CRDi Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2019}
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-01-29 06:01:29 [auto1.it] INFO: Saving data for RN24419: {'auction_closing_time': 1769704044.0, 'created_time': 1769458185.492975, 'last_price_update_time': 1769666489.665239}
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN24419') HTTP/1.1" 204 0
2026-01-29 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT66355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP48367> (referer: https://www.auto1.com/v1/car-details-view/UP48367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL30417> (referer: https://www.auto1.com/v1/car-details-view/XL30417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP03591> (referer: https://www.auto1.com/v1/car-details-view/PP03591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-01-29 06:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2e3a76-7810-5d6e-a16f-189a3ba21870 with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2e3a76-7810-5d6e-a16f-189a3ba21870 with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: da2e3a76-7810-5d6e-a16f-189a3ba21870, identifier: UP48367
2026-01-29 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-01-29 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-01-29 06:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162798 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162798
2026-01-29 06:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: da2e3a76-7810-5d6e-a16f-189a3ba21870 spider: auto1.it
2026-01-29 06:01:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: da2e3a76-7810-5d6e-a16f-189a3ba21870 due to rule: high_mileage_for_country.json, error: 162798 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162798
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:45:48Z',
'fuel_type': 'diesel',
'id': 'da2e3a76-7810-5d6e-a16f-189a3ba21870',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP48367',
'listing': 'auction',
'location': 'Giugliano in Campania',
'make': 'Fiat',
'model': '500X',
'odometer': 162798,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Pop Star',
'transmission': 'automatic',
'trim': 'Pop Star',
'year': 2018}
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-01-29 06:01:30 [auto1.it] INFO: Saving data for UP48367: {'auction_closing_time': 1769705148.0, 'created_time': 1769457754.120622, 'last_price_update_time': 1769666490.526847}
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UP48367') HTTP/1.1" 204 0
2026-01-29 06:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY89378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA86340> (referer: https://www.auto1.com/v1/car-details-view/CA86340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417
2026-01-29 06:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5231a76b-f35f-5d90-b627-c1022e02af71 with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5231a76b-f35f-5d90-b627-c1022e02af71 with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5231a76b-f35f-5d90-b627-c1022e02af71, identifier: XL30417
2026-01-29 06:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591
2026-01-29 06:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a62b49a-69fa-52f4-a787-2c48576ed20b with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a62b49a-69fa-52f4-a787-2c48576ed20b with scrape type 2
2026-01-29 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a62b49a-69fa-52f4-a787-2c48576ed20b, identifier: PP03591
2026-01-29 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417
2026-01-29 06:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417
2026-01-29 06:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417 to the API
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL30417>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-01-29T16:45:35Z',
'fuel_type': 'petrol',
'id': '5231a76b-f35f-5d90-b627-c1022e02af71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL30417',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': '124 Spider',
'odometer': 62163,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-30',
'seats_number': 2,
'seller_name': None,
'title': 'Fiat 124 Spider 1.4 Turbo Lusso',
'transmission': 'manual',
'trim': 'Lusso',
'year': 2018}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL30417%27 HTTP/1.1" 200 None
2026-01-29 06:01:31 [auto1.it] INFO: Saving data for XL30417: {'auction_closing_time': 1769705135.0, 'created_time': 1769458381.778878, 'last_price_update_time': 1769666491.465362}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL30417') HTTP/1.1" 204 0
2026-01-29 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591
2026-01-29 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591
2026-01-29 06:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591 to the API
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PP03591>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2026-01-29T16:23:39Z',
'fuel_type': 'petrol',
'id': '3a62b49a-69fa-52f4-a787-2c48576ed20b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP03591',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'BMW',
'model': '1er',
'odometer': 42954,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP03591%27 HTTP/1.1" 200 None
2026-01-29 06:01:31 [auto1.it] INFO: Saving data for PP03591: {'auction_closing_time': 1769703819.0, 'created_time': 1769458142.003982, 'last_price_update_time': 1769666491.813946}
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP03591') HTTP/1.1" 204 0
2026-01-29 06:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ25760> (referer: https://www.auto1.com/v1/car-details-view/LZ25760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL25385> (referer: https://www.auto1.com/v1/car-details-view/UL25385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:31 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340
2026-01-29 06:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with scrape type 2
2026-01-29 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with scrape type 2
2026-01-29 06:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d0e744a-dbea-5b75-a37e-68c6ad74b497, identifier: CA86340
2026-01-29 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340
2026-01-29 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340
2026-01-29 06:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340 to the API
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA86340>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-29T16:59:51Z',
'fuel_type': 'petrol',
'id': '1d0e744a-dbea-5b75-a37e-68c6ad74b497',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA86340',
'listing': 'auction',
'location': 'Legnano',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 8560,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Summit',
'transmission': 'manual',
'trim': 'Summit',
'year': 2024}
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA86340%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Saving data for CA86340: {'auction_closing_time': 1769705991.0, 'created_time': 1769457703.772396, 'last_price_update_time': 1769666492.368116}
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA86340') HTTP/1.1" 204 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: DZ39731
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ39731%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for DZ39731: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: XH51228
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH51228%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for XH51228: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: YW17704
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW17704%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for YW17704: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: WA99422
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA99422%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for WA99422: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: BS57464
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS57464%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for BS57464: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: SX06852
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX06852%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for SX06852: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: RY80591
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY80591%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for RY80591: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: YS06791
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS06791%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for YS06791: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: UA07437
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA07437%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for UA07437: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: TC41624
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC41624%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for TC41624: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: KT64780
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64780%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for KT64780: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: XN08896
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN08896%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for XN08896: 2
2026-01-29 06:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: LU29351
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU29351%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for LU29351: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: DH39383
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH39383%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for DH39383: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: LB25725
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB25725%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for LB25725: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: MU64340
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU64340%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for MU64340: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: AL26589
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL26589%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for AL26589: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: KL52080
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL52080%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for KL52080: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: TZ83605
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for TZ83605: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: EZ39176
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ39176%27 HTTP/1.1" 200 None
2026-01-29 06:01:32 [auto1.it] INFO: Scrape type for EZ39176: 0
2026-01-29 06:01:32 [auto1.it] INFO: Found listing with ID: DK89708
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK89708%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for DK89708: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: MX37166
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX37166%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for MX37166: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: JA19624
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA19624%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for JA19624: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: JH21247
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH21247%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for JH21247: 2
2026-01-29 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC09499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL53737> (referer: https://www.auto1.com/v1/car-details-view/YL53737/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG41952> (referer: https://www.auto1.com/v1/car-details-view/MG41952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760
2026-01-29 06:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with scrape type 2
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with scrape type 2
2026-01-29 06:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7, identifier: LZ25760
2026-01-29 06:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385
2026-01-29 06:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with scrape type 2
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with scrape type 2
2026-01-29 06:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf, identifier: UL25385
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: DR27606
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27606%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for DR27606: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: WP90453
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP90453%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for WP90453: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: TH12767
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for TH12767: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: KW94897
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW94897%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for KW94897: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: YJ87014
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87014%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for YJ87014: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: EY68102
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY68102%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for EY68102: 0
2026-01-29 06:01:33 [auto1.it] INFO: Found listing with ID: CN82812
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN82812%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Scrape type for CN82812: 2
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760
2026-01-29 06:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760
2026-01-29 06:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760 to the API
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ25760>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 292,
'expiration_date': '2026-01-29T16:46:33Z',
'fuel_type': 'hybrid',
'id': 'ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ25760',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'BMW',
'model': '5er',
'odometer': 86538,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530e xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2021}
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2026-01-29 06:01:33 [auto1.it] INFO: Saving data for LZ25760: {'auction_closing_time': 1769705193.0, 'created_time': 1769026119.441657, 'last_price_update_time': 1769666493.915289}
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ25760') HTTP/1.1" 204 0
2026-01-29 06:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385
2026-01-29 06:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385
2026-01-29 06:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385 to the API
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL25385>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 300,
'expiration_date': '2026-01-29T16:09:39Z',
'fuel_type': 'hybrid',
'id': 'dd8eabf6-68b8-5da5-b9b1-e2b0325113cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL25385',
'listing': 'auction',
'location': "IT, Fiorenzuola D'Arda (PC)",
'make': 'Opel',
'model': 'Grandland X',
'odometer': 125039,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.6 Plug-in Hybrid 4 Design Line',
'transmission': 'automatic',
'trim': 'Design Line',
'year': 2021}
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL25385%27 HTTP/1.1" 200 None
2026-01-29 06:01:34 [auto1.it] INFO: Saving data for UL25385: {'auction_closing_time': 1769702979.0, 'created_time': 1769457901.997524, 'last_price_update_time': 1769666494.519087}
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL25385') HTTP/1.1" 204 0
2026-01-29 06:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:34 [auto1.it] INFO: Found listing with ID: NP55119
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP55119%27 HTTP/1.1" 200 None
2026-01-29 06:01:34 [auto1.it] INFO: Scrape type for NP55119: 2
2026-01-29 06:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-01-29 06:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84e96b8-b29e-506f-a259-a9c4d1a64df5 with scrape type 2
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84e96b8-b29e-506f-a259-a9c4d1a64df5 with scrape type 2
2026-01-29 06:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d84e96b8-b29e-506f-a259-a9c4d1a64df5, identifier: YL53737
2026-01-29 06:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952
2026-01-29 06:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedb1903-f8e0-58ee-8d20-04e44bf832f6 with scrape type 2
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cedb1903-f8e0-58ee-8d20-04e44bf832f6 with scrape type 2
2026-01-29 06:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cedb1903-f8e0-58ee-8d20-04e44bf832f6, identifier: MG41952
2026-01-29 06:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB40645> (referer: https://www.auto1.com/v1/car-details-view/ZB40645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH01069> (referer: https://www.auto1.com/v1/car-details-view/EH01069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP36812> (referer: https://www.auto1.com/v1/car-details-view/SP36812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-01-29 06:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-01-29 06:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737 to the API
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL53737>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-29T16:48:06Z',
'fuel_type': 'diesel',
'id': 'd84e96b8-b29e-506f-a259-a9c4d1a64df5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL53737',
'listing': 'auction',
'location': 'Foggia',
'make': 'Audi',
'model': 'Q3',
'odometer': 70738,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 40 TDI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2020}
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-01-29 06:01:35 [auto1.it] INFO: Saving data for YL53737: {'auction_closing_time': 1769705286.0, 'created_time': 1769458535.881674, 'last_price_update_time': 1769666495.210568}
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL53737') HTTP/1.1" 204 0
2026-01-29 06:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952
2026-01-29 06:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952
2026-01-29 06:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952 to the API
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MG41952>
{'auction_title': '',
'c_o_2_emission_value': 185,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 245,
'expiration_date': '2026-01-29T16:43:41Z',
'fuel_type': 'petrol',
'id': 'cedb1903-f8e0-58ee-8d20-04e44bf832f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG41952',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Porsche',
'model': 'Macan',
'odometer': 132397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan Basis',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG41952%27 HTTP/1.1" 200 None
2026-01-29 06:01:35 [auto1.it] INFO: Saving data for MG41952: {'auction_closing_time': 1769705021.0, 'created_time': 1768594215.794878, 'last_price_update_time': 1769666495.687707}
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MG41952') HTTP/1.1" 204 0
2026-01-29 06:01:35 [auto1.it] INFO: Found listing with ID: XU61631
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU61631%27 HTTP/1.1" 200 None
2026-01-29 06:01:35 [auto1.it] INFO: Scrape type for XU61631: 2
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:35 [auto1.it] INFO: Found listing with ID: CL92988
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL92988%27 HTTP/1.1" 200 None
2026-01-29 06:01:35 [auto1.it] INFO: Scrape type for CL92988: 2
2026-01-29 06:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645
2026-01-29 06:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bf362b-0887-5f89-9fcc-c5965d51795b with scrape type 2
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73bf362b-0887-5f89-9fcc-c5965d51795b with scrape type 2
2026-01-29 06:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73bf362b-0887-5f89-9fcc-c5965d51795b, identifier: ZB40645
2026-01-29 06:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069
2026-01-29 06:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with scrape type 2
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9, identifier: EH01069
2026-01-29 06:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812
2026-01-29 06:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb6246ac-b3e4-5237-a992-04851cc77fdc with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb6246ac-b3e4-5237-a992-04851cc77fdc with scrape type 2
2026-01-29 06:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb6246ac-b3e4-5237-a992-04851cc77fdc, identifier: SP36812
2026-01-29 06:01:36 [auto1.it] INFO: Found listing with ID: AH34632
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH34632%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.it] INFO: Scrape type for AH34632: 0
2026-01-29 06:01:36 [auto1.it] INFO: Found listing with ID: YV35644
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV35644%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.it] INFO: Scrape type for YV35644: 0
2026-01-29 06:01:36 [auto1.it] INFO: Found listing with ID: GC68845
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC68845%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.it] INFO: Scrape type for GC68845: 0
2026-01-29 06:01:36 [auto1.it] INFO: Found listing with ID: HW78995
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW78995%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.it] INFO: Scrape type for HW78995: 0
2026-01-29 06:01:36 [auto1.it] INFO: Found listing with ID: AZ36136
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ36136%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.it] INFO: Scrape type for AZ36136: 0
2026-01-29 06:01:36 [auto1.it] INFO: Found listing with ID: KD59831
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD59831%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.it] INFO: Scrape type for KD59831: 0
2026-01-29 06:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645
2026-01-29 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645
2026-01-29 06:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645 to the API
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB40645>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-01-29T16:31:08Z',
'fuel_type': 'petrol',
'id': '73bf362b-0887-5f89-9fcc-c5965d51795b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB40645',
'listing': 'auction',
'location': 'IT, Imola',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 34943,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB40645%27 HTTP/1.1" 200 None
2026-01-29 06:01:36 [auto1.it] INFO: Saving data for ZB40645: {'auction_closing_time': 1769704268.0, 'created_time': 1769458427.628137, 'last_price_update_time': 1769666496.633259}
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZB40645') HTTP/1.1" 204 0
2026-01-29 06:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069
2026-01-29 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069
2026-01-29 06:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069 to the API
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH01069>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-01-29T16:22:16Z',
'fuel_type': 'diesel',
'id': 'dd6d4825-f40e-58e4-9909-9d0c53b6bfc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH01069',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volvo',
'model': 'XC60',
'odometer': 104259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Core 2WD',
'transmission': 'automatic',
'trim': 'Core 2WD',
'year': 2022}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH01069%27 HTTP/1.1" 200 None
2026-01-29 06:01:37 [auto1.it] INFO: Saving data for EH01069: {'auction_closing_time': 1769703736.0, 'created_time': 1768464058.500176, 'last_price_update_time': 1769666497.111299}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH01069') HTTP/1.1" 204 0
2026-01-29 06:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812
2026-01-29 06:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812
2026-01-29 06:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812 to the API
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SP36812>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 306,
'expiration_date': '2026-01-29T16:21:05Z',
'fuel_type': 'petrol',
'id': 'fb6246ac-b3e4-5237-a992-04851cc77fdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP36812',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 81561,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP36812%27 HTTP/1.1" 200 None
2026-01-29 06:01:37 [auto1.it] INFO: Saving data for SP36812: {'auction_closing_time': 1769703665.0, 'created_time': 1769025642.799941, 'last_price_update_time': 1769666497.517838}
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP36812') HTTP/1.1" 204 0
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY89378> (referer: https://www.auto1.com/v1/car-details-view/GY89378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT66355> (referer: https://www.auto1.com/v1/car-details-view/FT66355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN08896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378
2026-01-29 06:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecaed355-487c-59e6-b231-0ca0caf1c0ed with scrape type 2
2026-01-29 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecaed355-487c-59e6-b231-0ca0caf1c0ed with scrape type 2
2026-01-29 06:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ecaed355-487c-59e6-b231-0ca0caf1c0ed, identifier: GY89378
2026-01-29 06:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378
2026-01-29 06:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378
2026-01-29 06:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378 to the API
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY89378>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:30:50Z',
'fuel_type': 'diesel',
'id': 'ecaed355-487c-59e6-b231-0ca0caf1c0ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY89378',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'BMW',
'model': 'X1',
'odometer': 81486,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 16d',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY89378%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Saving data for GY89378: {'auction_closing_time': 1769704250.0, 'created_time': 1769458418.643215, 'last_price_update_time': 1769666498.201397}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY89378') HTTP/1.1" 204 0
2026-01-29 06:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b454ad-95a7-506b-936e-fd57c5608380 with identifier: FT66355
2026-01-29 06:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b454ad-95a7-506b-936e-fd57c5608380 with scrape type 2
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97b454ad-95a7-506b-936e-fd57c5608380 with scrape type 2
2026-01-29 06:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97b454ad-95a7-506b-936e-fd57c5608380, identifier: FT66355
2026-01-29 06:01:38 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97b454ad-95a7-506b-936e-fd57c5608380 with identifier: FT66355
2026-01-29 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97b454ad-95a7-506b-936e-fd57c5608380 with identifier: FT66355
2026-01-29 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154699 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154699
2026-01-29 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 97b454ad-95a7-506b-936e-fd57c5608380 spider: auto1.it
2026-01-29 06:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 97b454ad-95a7-506b-936e-fd57c5608380 due to rule: high_mileage_for_country.json, error: 154699 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154699
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-01-29T16:07:31Z',
'fuel_type': 'diesel',
'id': '97b454ad-95a7-506b-936e-fd57c5608380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT66355',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'A6',
'odometer': 154699,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-14',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 35 TDI Mild-Hybrid sport',
'transmission': 'automatic',
'trim': 'sport',
'year': 2020}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT66355%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Saving data for FT66355: {'auction_closing_time': 1769702851.0, 'created_time': 1768939596.049252, 'last_price_update_time': 1769666498.624616}
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT66355') HTTP/1.1" 204 0
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: AK95829
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK95829%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for AK95829: 0
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: JE15416
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE15416%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for JE15416: 2
2026-01-29 06:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH21247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: RB81856
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB81856%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for RB81856: 0
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: SG87196
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG87196%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for SG87196: 2
2026-01-29 06:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: PS84479
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for PS84479: 2
2026-01-29 06:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP55119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: SG78459
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG78459%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for SG78459: 0
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: WT09600
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT09600%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for WT09600: 0
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: AS00040
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS00040%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for AS00040: 0
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: NK32002
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK32002%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for NK32002: 2
2026-01-29 06:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: BG40682
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG40682%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for BG40682: 0
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: PM87024
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM87024%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for PM87024: 2
2026-01-29 06:01:38 [auto1.it] INFO: Found listing with ID: NG74900
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74900%27 HTTP/1.1" 200 None
2026-01-29 06:01:38 [auto1.it] INFO: Scrape type for NG74900: 2
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: SY35335
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY35335%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for SY35335: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: TL58155
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL58155%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for TL58155: 2
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN82812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: VP20298
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP20298%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for VP20298: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: NA73854
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA73854%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for NA73854: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: YA41341
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA41341%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for YA41341: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: WW83392
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83392%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for WW83392: 2
2026-01-29 06:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC09499> (referer: https://www.auto1.com/v1/car-details-view/YC09499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: LT39464
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT39464%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for LT39464: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: SB54869
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB54869%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for SB54869: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: ZP37659
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP37659%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for ZP37659: 2
2026-01-29 06:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: DP76328
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for DP76328: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: LX93740
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93740%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for LX93740: 2
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: VW84140
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW84140%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for VW84140: 0
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: EG40810
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG40810%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for EG40810: 2
2026-01-29 06:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499
2026-01-29 06:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1c7450-019d-5309-9bf8-573cd3362ba6 with scrape type 2
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd1c7450-019d-5309-9bf8-573cd3362ba6 with scrape type 2
2026-01-29 06:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd1c7450-019d-5309-9bf8-573cd3362ba6, identifier: YC09499
2026-01-29 06:01:39 [auto1.it] INFO: Found listing with ID: SB20175
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB20175%27 HTTP/1.1" 200 None
2026-01-29 06:01:39 [auto1.it] INFO: Scrape type for SB20175: 2
2026-01-29 06:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499
2026-01-29 06:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499
2026-01-29 06:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499 to the API
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC09499>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:16:26Z',
'fuel_type': 'petrol',
'id': 'bd1c7450-019d-5309-9bf8-573cd3362ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC09499',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 24996,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Ultimate',
'transmission': 'manual',
'trim': 'Ultimate',
'year': 2023}
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC09499%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Saving data for YC09499: {'auction_closing_time': 1769703386.0, 'created_time': 1769457820.972846, 'last_price_update_time': 1769666500.115}
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YC09499') HTTP/1.1" 204 0
2026-01-29 06:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL92988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: FT72404
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT72404%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for FT72404: 2
2026-01-29 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN08896> (referer: https://www.auto1.com/v1/car-details-view/XN08896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG87196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE15416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: WB82138
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB82138%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for WB82138: 2
2026-01-29 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: DY55087
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY55087%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for DY55087: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: HD77272
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD77272%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for HD77272: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: UA81726
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for UA81726: 2
2026-01-29 06:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU61631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:40 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: SK32602
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK32602%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for SK32602: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: YM26268
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM26268%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for YM26268: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: FG75193
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG75193%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for FG75193: 2
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: PY58438
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58438%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for PY58438: 2
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: RD39232
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD39232%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for RD39232: 2
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: PM64669
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM64669%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for PM64669: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: RZ31448
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31448%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for RZ31448: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: PG92884
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG92884%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for PG92884: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: BY77891
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY77891%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for BY77891: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: EG37801
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for EG37801: 2
2026-01-29 06:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896
2026-01-29 06:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with scrape type 2
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with scrape type 2
2026-01-29 06:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3, identifier: XN08896
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: NK14048
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK14048%27 HTTP/1.1" 200 None
2026-01-29 06:01:40 [auto1.it] INFO: Scrape type for NK14048: 0
2026-01-29 06:01:40 [auto1.it] INFO: Found listing with ID: KZ89733
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ89733%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for KZ89733: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: GW95975
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW95975%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for GW95975: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: FK29975
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK29975%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for FK29975: 2
2026-01-29 06:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896
2026-01-29 06:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896
2026-01-29 06:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896 to the API
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XN08896>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:27:03Z',
'fuel_type': 'petrol',
'id': '9c088b92-f4be-5ba0-ae8c-3c469797a6c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN08896',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 73305,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2019}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN08896%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Saving data for XN08896: {'auction_closing_time': 1769704023.0, 'created_time': 1769458555.130719, 'last_price_update_time': 1769666501.534811}
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XN08896') HTTP/1.1" 204 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: KR39875
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR39875%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for KR39875: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: DL88006
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL88006%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for DL88006: 2
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: ZC30818
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC30818%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for ZC30818: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: NC33689
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC33689%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for NC33689: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: KW61095
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW61095%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for KW61095: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: GT57275
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT57275%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for GT57275: 2
2026-01-29 06:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS84479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK32002/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: JY88451
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY88451%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for JY88451: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: TD32917
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD32917%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for TD32917: 2
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: WY47347
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY47347%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for WY47347: 2
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: SX21988
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21988%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for SX21988: 0
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: EJ52499
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52499%27 HTTP/1.1" 200 None
2026-01-29 06:01:41 [auto1.it] INFO: Scrape type for EJ52499: 2
2026-01-29 06:01:41 [auto1.it] INFO: Found listing with ID: NV95469
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV95469%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for NV95469: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: MB19199
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB19199%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for MB19199: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: TS00967
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS00967%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for TS00967: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: JD91728
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD91728%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for JD91728: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: HT84614
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT84614%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for HT84614: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: JG91942
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG91942%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for JG91942: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: TB86864
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB86864%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for TB86864: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: VB04697
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04697%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for VB04697: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: BL38298
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL38298%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for BL38298: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: JF49505
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF49505%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for JF49505: 2
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: GN66049
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN66049%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for GN66049: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: XX93574
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93574%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for XX93574: 2
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: PT59724
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT59724%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for PT59724: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: AF71631
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF71631%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for AF71631: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: AV53381
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53381%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for AV53381: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: FX76200
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX76200%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for FX76200: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: WN11922
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN11922%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for WN11922: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: ZL90358
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL90358%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for ZL90358: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: FY62272
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY62272%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for FY62272: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: LM64931
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM64931%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for LM64931: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: JP83347
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP83347%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for JP83347: 2
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: AR75288
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for AR75288: 2
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG74900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL58155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: AD90482
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD90482%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for AD90482: 0
2026-01-29 06:01:42 [auto1.it] INFO: Found listing with ID: RL99937
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL99937%27 HTTP/1.1" 200 None
2026-01-29 06:01:42 [auto1.it] INFO: Scrape type for RL99937: 0
2026-01-29 06:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP55119> (referer: https://www.auto1.com/v1/car-details-view/NP55119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW83392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f564fab-d87d-57ad-84ef-560497aacf2d with identifier: NP55119
2026-01-29 06:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f564fab-d87d-57ad-84ef-560497aacf2d with scrape type 2
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f564fab-d87d-57ad-84ef-560497aacf2d with scrape type 2
2026-01-29 06:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f564fab-d87d-57ad-84ef-560497aacf2d, identifier: NP55119
2026-01-29 06:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f564fab-d87d-57ad-84ef-560497aacf2d with identifier: NP55119
2026-01-29 06:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f564fab-d87d-57ad-84ef-560497aacf2d with identifier: NP55119
2026-01-29 06:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
2026-01-29 06:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2f564fab-d87d-57ad-84ef-560497aacf2d spider: auto1.it
2026-01-29 06:01:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 2f564fab-d87d-57ad-84ef-560497aacf2d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
{'auction_title': '',
'c_o_2_emission_value': 203,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:34:05Z',
'fuel_type': 'diesel',
'id': '2f564fab-d87d-57ad-84ef-560497aacf2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP55119',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 156899,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-24',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline FWD',
'transmission': 'automatic',
'trim': 'Trendline FWD',
'year': 2021}
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP55119%27 HTTP/1.1" 200 None
2026-01-29 06:01:43 [auto1.it] INFO: Saving data for NP55119: {'auction_closing_time': 1769704445.0, 'created_time': 1768075405.071264, 'last_price_update_time': 1769666503.172725}
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP55119') HTTP/1.1" 204 0
2026-01-29 06:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM87024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH21247> (referer: https://www.auto1.com/v1/car-details-view/JH21247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP37659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN82812> (referer: https://www.auto1.com/v1/car-details-view/CN82812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 517eb998-bec1-5d6b-b5e2-6b397518a8db with identifier: JH21247
2026-01-29 06:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 517eb998-bec1-5d6b-b5e2-6b397518a8db with scrape type 2
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 517eb998-bec1-5d6b-b5e2-6b397518a8db with scrape type 2
2026-01-29 06:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 517eb998-bec1-5d6b-b5e2-6b397518a8db, identifier: JH21247
2026-01-29 06:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 517eb998-bec1-5d6b-b5e2-6b397518a8db with identifier: JH21247
2026-01-29 06:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 517eb998-bec1-5d6b-b5e2-6b397518a8db with identifier: JH21247
2026-01-29 06:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158891 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158891
2026-01-29 06:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 517eb998-bec1-5d6b-b5e2-6b397518a8db spider: auto1.it
2026-01-29 06:01:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 517eb998-bec1-5d6b-b5e2-6b397518a8db due to rule: high_mileage_for_country.json, error: 158891 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158891
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.9L',
'engine_horse_power': 285,
'expiration_date': '2026-01-29T16:51:46Z',
'fuel_type': 'diesel',
'id': '517eb998-bec1-5d6b-b5e2-6b397518a8db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH21247',
'listing': 'auction',
'location': "Cassano D'Adda",
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 158891,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic Premium',
'transmission': 'automatic',
'trim': '4Matic Premium',
'year': 2018}
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH21247%27 HTTP/1.1" 200 None
2026-01-29 06:01:43 [auto1.it] INFO: Saving data for JH21247: {'auction_closing_time': 1769705506.0, 'created_time': 1769457828.951325, 'last_price_update_time': 1769666503.869132}
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH21247') HTTP/1.1" 204 0
2026-01-29 06:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812
2026-01-29 06:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd6a2dda-6524-508f-b995-6c740d76d25f with scrape type 2
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd6a2dda-6524-508f-b995-6c740d76d25f with scrape type 2
2026-01-29 06:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd6a2dda-6524-508f-b995-6c740d76d25f, identifier: CN82812
2026-01-29 06:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812
2026-01-29 06:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812
2026-01-29 06:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812 to the API
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN82812>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 129,
'expiration_date': '2026-01-29T16:38:35Z',
'fuel_type': 'petrol',
'id': 'fd6a2dda-6524-508f-b995-6c740d76d25f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN82812',
'listing': 'auction',
'location': 'IT, Casamassima',
'make': 'Volvo',
'model': 'XC40',
'odometer': 15183,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T2 Core 2WD',
'transmission': 'manual',
'trim': 'Core 2WD',
'year': 2022}
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN82812%27 HTTP/1.1" 200 None
2026-01-29 06:01:44 [auto1.it] INFO: Saving data for CN82812: {'auction_closing_time': 1769704715.0, 'created_time': 1769457903.5593, 'last_price_update_time': 1769666504.574594}
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CN82812') HTTP/1.1" 204 0
2026-01-29 06:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT72404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG40810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB20175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX93740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: YY06074
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for YY06074: 2
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: MG24546
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG24546%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for MG24546: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: NF65001
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF65001%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for NF65001: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: JS30214
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS30214%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for JS30214: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: XD70855
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for XD70855: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: VY49338
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY49338%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for VY49338: 2
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL88006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: VS63491
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63491%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for VS63491: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: FJ86916
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ86916%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for FJ86916: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: ML60826
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML60826%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for ML60826: 2
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB82138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: FU48439
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU48439%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for FU48439: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: BP48595
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP48595%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for BP48595: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: GX60446
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX60446%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for GX60446: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: UU64650
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64650%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for UU64650: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: BW17838
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW17838%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for BW17838: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: ZP16966
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP16966%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for ZP16966: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: AY21953
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21953%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for AY21953: 2
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: KN31697
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN31697%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for KN31697: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: SJ77848
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ77848%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for SJ77848: 2
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU61631> (referer: https://www.auto1.com/v1/car-details-view/XU61631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR75288/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX93574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP83347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: DS86175
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS86175%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for DS86175: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: ML77651
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML77651%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for ML77651: 2
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: ET25388
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET25388%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for ET25388: 2
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL58155> (referer: https://www.auto1.com/v1/car-details-view/TL58155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: XW74392
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW74392%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for XW74392: 2
2026-01-29 06:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: WD98953
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for WD98953: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: UW51000
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW51000%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for UW51000: 2
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: JS38459
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS38459%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for JS38459: 2
2026-01-29 06:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with identifier: XU61631
2026-01-29 06:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with scrape type 2
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with scrape type 2
2026-01-29 06:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab, identifier: XU61631
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: HA56454
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA56454%27 HTTP/1.1" 200 None
2026-01-29 06:01:45 [auto1.it] INFO: Scrape type for HA56454: 0
2026-01-29 06:01:45 [auto1.it] INFO: Found listing with ID: SX30398
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX30398%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for SX30398: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: NL47896
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL47896%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for NL47896: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: NC94766
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for NC94766: 2
2026-01-29 06:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with identifier: XU61631
2026-01-29 06:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with identifier: XU61631
2026-01-29 06:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172314 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172314
2026-01-29 06:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab spider: auto1.it
2026-01-29 06:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab due to rule: high_mileage_for_country.json, error: 172314 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172314
{'auction_title': '',
'c_o_2_emission_value': 34,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2026-01-29T16:47:06Z',
'fuel_type': 'hybrid',
'id': 'c1bbb563-8181-5dc8-bf5e-ef35676ed9ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU61631',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 172314,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-07',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid Business 4x4',
'transmission': 'automatic',
'trim': 'Business 4x4',
'year': 2020}
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU61631%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Saving data for XU61631: {'auction_closing_time': 1769705226.0, 'created_time': 1768248389.604365, 'last_price_update_time': 1769666506.29933}
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU61631') HTTP/1.1" 204 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: CH15659
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH15659%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for CH15659: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: LL61662
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL61662%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for LL61662: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: EW00290
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW00290%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for EW00290: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: FP41040
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP41040%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for FP41040: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: FL81040
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL81040%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for FL81040: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: YA96052
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA96052%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for YA96052: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: UW96033
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96033%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for UW96033: 0
2026-01-29 06:01:46 [auto1.it] INFO: Found listing with ID: AD03373
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD03373%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Scrape type for AD03373: 2
2026-01-29 06:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41a3236-9234-5366-a616-1a624aab9cf6 with identifier: TL58155
2026-01-29 06:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41a3236-9234-5366-a616-1a624aab9cf6 with scrape type 2
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41a3236-9234-5366-a616-1a624aab9cf6 with scrape type 2
2026-01-29 06:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a41a3236-9234-5366-a616-1a624aab9cf6, identifier: TL58155
2026-01-29 06:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG74900> (referer: https://www.auto1.com/v1/car-details-view/NG74900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a41a3236-9234-5366-a616-1a624aab9cf6 with identifier: TL58155
2026-01-29 06:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a41a3236-9234-5366-a616-1a624aab9cf6 with identifier: TL58155
2026-01-29 06:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145374 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
145374
2026-01-29 06:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a41a3236-9234-5366-a616-1a624aab9cf6 spider: auto1.it
2026-01-29 06:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a41a3236-9234-5366-a616-1a624aab9cf6 due to rule: high_mileage_for_make.json, error: 145374 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
145374
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2026-01-29T16:19:06Z',
'fuel_type': 'diesel',
'id': 'a41a3236-9234-5366-a616-1a624aab9cf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL58155',
'listing': 'auction',
'location': 'IT',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 145374,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
'transmission': 'automatic',
'trim': 'Q4 Lusso',
'year': 2019}
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL58155%27 HTTP/1.1" 200 None
2026-01-29 06:01:46 [auto1.it] INFO: Saving data for TL58155: {'auction_closing_time': 1769703546.0, 'created_time': 1769025969.886508, 'last_price_update_time': 1769666506.965115}
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL58155') HTTP/1.1" 204 0
2026-01-29 06:01:47 [auto1.it] INFO: Found listing with ID: TB52041
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB52041%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.it] INFO: Scrape type for TB52041: 2
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK32002> (referer: https://www.auto1.com/v1/car-details-view/NK32002/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:47 [auto1.it] INFO: Found listing with ID: AD85366
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85366%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.it] INFO: Scrape type for AD85366: 0
2026-01-29 06:01:47 [auto1.it] INFO: Found listing with ID: VG35623
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG35623%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.it] INFO: Scrape type for VG35623: 0
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900
2026-01-29 06:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be62ec41-2206-5668-b03c-7175e697eaa9 with scrape type 2
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be62ec41-2206-5668-b03c-7175e697eaa9 with scrape type 2
2026-01-29 06:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be62ec41-2206-5668-b03c-7175e697eaa9, identifier: NG74900
2026-01-29 06:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-01-29 06:01:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900
2026-01-29 06:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900 to the API
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG74900>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-01-29T16:12:28Z',
'fuel_type': 'petrol',
'id': 'be62ec41-2206-5668-b03c-7175e697eaa9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG74900',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 12483,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2022}
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74900%27 HTTP/1.1" 200 None
2026-01-29 06:01:47 [auto1.it] INFO: Saving data for NG74900: {'auction_closing_time': 1769703148.0, 'created_time': 1768939273.148088, 'last_price_update_time': 1769666507.710344}
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG74900') HTTP/1.1" 204 0
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF49505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP37659> (referer: https://www.auto1.com/v1/car-details-view/ZP37659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW83392> (referer: https://www.auto1.com/v1/car-details-view/WW83392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ52499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS84479> (referer: https://www.auto1.com/v1/car-details-view/PS84479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with identifier: NK32002
2026-01-29 06:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with scrape type 2
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with scrape type 2
2026-01-29 06:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4, identifier: NK32002
2026-01-29 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with identifier: NK32002
2026-01-29 06:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with identifier: NK32002
2026-01-29 06:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189728 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
189728
2026-01-29 06:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 spider: auto1.it
2026-01-29 06:01:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 due to rule: high_mileage_for_country.json, error: 189728 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
189728
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 286,
'expiration_date': '2026-01-29T16:27:00Z',
'fuel_type': 'diesel',
'id': '767e7ce0-dc20-5b24-8c23-b2d5f3a803d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK32002',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 189728,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK32002%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.it] INFO: Saving data for NK32002: {'auction_closing_time': 1769704020.0, 'created_time': 1768471730.837392, 'last_price_update_time': 1769666508.191891}
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK32002') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d69b829-da51-529b-9b52-aaf9207456df with identifier: ZP37659
2026-01-29 06:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d69b829-da51-529b-9b52-aaf9207456df with scrape type 2
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d69b829-da51-529b-9b52-aaf9207456df with scrape type 2
2026-01-29 06:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d69b829-da51-529b-9b52-aaf9207456df, identifier: ZP37659
2026-01-29 06:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392
2026-01-29 06:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bcbed7d-ef0f-58a4-ab35-12e37807741b with scrape type 2
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bcbed7d-ef0f-58a4-ab35-12e37807741b with scrape type 2
2026-01-29 06:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bcbed7d-ef0f-58a4-ab35-12e37807741b, identifier: WW83392
2026-01-29 06:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-01-29 06:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c8f05e-0de6-5509-aab0-060a264f9e11 with scrape type 2
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97c8f05e-0de6-5509-aab0-060a264f9e11 with scrape type 2
2026-01-29 06:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97c8f05e-0de6-5509-aab0-060a264f9e11, identifier: PS84479
2026-01-29 06:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d69b829-da51-529b-9b52-aaf9207456df with identifier: ZP37659
2026-01-29 06:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d69b829-da51-529b-9b52-aaf9207456df with identifier: ZP37659
2026-01-29 06:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153309 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153309
2026-01-29 06:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3d69b829-da51-529b-9b52-aaf9207456df spider: auto1.it
2026-01-29 06:01:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3d69b829-da51-529b-9b52-aaf9207456df due to rule: high_mileage_for_country.json, error: 153309 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153309
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:52:49Z',
'fuel_type': 'diesel',
'id': '3d69b829-da51-529b-9b52-aaf9207456df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP37659',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'BMW',
'model': '1er',
'odometer': 153309,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP37659%27 HTTP/1.1" 200 None
2026-01-29 06:01:48 [auto1.it] INFO: Saving data for ZP37659: {'auction_closing_time': 1769705569.0, 'created_time': 1769457824.890067, 'last_price_update_time': 1769666508.924042}
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZP37659') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392
2026-01-29 06:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392
2026-01-29 06:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392 to the API
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW83392>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.4L',
'engine_horse_power': 165,
'expiration_date': '2026-01-29T16:48:21Z',
'fuel_type': 'petrol',
'id': '7bcbed7d-ef0f-58a4-ab35-12e37807741b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW83392',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Abarth',
'model': '595',
'odometer': 1520,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-04-22',
'seats_number': 4,
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83392%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.it] INFO: Saving data for WW83392: {'auction_closing_time': 1769705301.0, 'created_time': 1769457945.95306, 'last_price_update_time': 1769666511.217283}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW83392') HTTP/1.1" 204 0
2026-01-29 06:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-01-29 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-01-29 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185899 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185899
2026-01-29 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 97c8f05e-0de6-5509-aab0-060a264f9e11 spider: auto1.it
2026-01-29 06:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 97c8f05e-0de6-5509-aab0-060a264f9e11 due to rule: high_mileage_for_country.json, error: 185899 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185899
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-01-29T16:23:16Z',
'fuel_type': 'diesel',
'id': '97c8f05e-0de6-5509-aab0-060a264f9e11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS84479',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Peugeot',
'model': '5008',
'odometer': 185899,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-15',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.it] INFO: Saving data for PS84479: {'auction_closing_time': 1769703796.0, 'created_time': 1768075342.763597, 'last_price_update_time': 1769666511.529452}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS84479') HTTP/1.1" 204 0
2026-01-29 06:01:51 [scrapy.extensions.logstats] INFO: Crawled 124 pages (at 124 pages/min), scraped 35 items (at 35 items/min)
2026-01-29 06:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX93740> (referer: https://www.auto1.com/v1/car-details-view/LX93740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY49338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM87024> (referer: https://www.auto1.com/v1/car-details-view/PM87024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740
2026-01-29 06:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with scrape type 2
2026-01-29 06:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with scrape type 2
2026-01-29 06:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6, identifier: LX93740
2026-01-29 06:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740
2026-01-29 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740
2026-01-29 06:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740 to the API
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX93740>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:57:52Z',
'fuel_type': 'diesel',
'id': 'bb76ab51-6a3a-5d50-a0a0-a6d3844844a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX93740',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 39856,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93740%27 HTTP/1.1" 200 None
2026-01-29 06:01:52 [auto1.it] INFO: Saving data for LX93740: {'auction_closing_time': 1769705872.0, 'created_time': 1769026047.098028, 'last_price_update_time': 1769666512.10534}
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX93740') HTTP/1.1" 204 0
2026-01-29 06:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024
2026-01-29 06:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23a15058-e35d-59fc-9ca8-f67ce867bd26 with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23a15058-e35d-59fc-9ca8-f67ce867bd26 with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23a15058-e35d-59fc-9ca8-f67ce867bd26, identifier: PM87024
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML60826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024
2026-01-29 06:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024
2026-01-29 06:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024 to the API
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM87024>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:25:00Z',
'fuel_type': 'diesel',
'id': '23a15058-e35d-59fc-9ca8-f67ce867bd26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM87024',
'listing': 'auction',
'location': 'Livorno',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 82152,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM87024%27 HTTP/1.1" 200 None
2026-01-29 06:01:52 [auto1.it] INFO: Saving data for PM87024: {'auction_closing_time': 1769703900.0, 'created_time': 1769458444.255674, 'last_price_update_time': 1769666512.629192}
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM87024') HTTP/1.1" 204 0
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY21953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL88006> (referer: https://www.auto1.com/v1/car-details-view/DL88006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB82138> (referer: https://www.auto1.com/v1/car-details-view/WB82138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006
2026-01-29 06:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd2782f-ddfb-5a20-99b3-f363c0695802 with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dd2782f-ddfb-5a20-99b3-f363c0695802 with scrape type 2
2026-01-29 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6dd2782f-ddfb-5a20-99b3-f363c0695802, identifier: DL88006
2026-01-29 06:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006
2026-01-29 06:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006
2026-01-29 06:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006 to the API
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DL88006>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:05:02Z',
'fuel_type': 'petrol',
'id': '6dd2782f-ddfb-5a20-99b3-f363c0695802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL88006',
'listing': 'auction',
'location': 'Genova',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 45447,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL88006%27 HTTP/1.1" 200 None
2026-01-29 06:01:53 [auto1.it] INFO: Saving data for DL88006: {'auction_closing_time': 1769702702.0, 'created_time': 1769457896.622277, 'last_price_update_time': 1769666513.285506}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DL88006') HTTP/1.1" 204 0
2026-01-29 06:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138
2026-01-29 06:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with scrape type 2
2026-01-29 06:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with scrape type 2
2026-01-29 06:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0, identifier: WB82138
2026-01-29 06:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ77848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138
2026-01-29 06:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138 to the API
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB82138>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:36:28Z',
'fuel_type': 'petrol',
'id': 'b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB82138',
'listing': 'auction',
'location': 'IT, Foggia',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 113532,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-16',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
'transmission': 'automatic',
'trim': 'ACT',
'year': 2021}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB82138%27 HTTP/1.1" 200 None
2026-01-29 06:01:53 [auto1.it] INFO: Saving data for WB82138: {'auction_closing_time': 1769704588.0, 'created_time': 1769458476.297913, 'last_price_update_time': 1769666513.774968}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WB82138') HTTP/1.1" 204 0
2026-01-29 06:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB52041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET25388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD03373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR75288> (referer: https://www.auto1.com/v1/car-details-view/AR75288/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-01-29 06:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c94059-c0dc-5c7b-b872-9af3291319e9 with scrape type 2
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1c94059-c0dc-5c7b-b872-9af3291319e9 with scrape type 2
2026-01-29 06:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1c94059-c0dc-5c7b-b872-9af3291319e9, identifier: AR75288
2026-01-29 06:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-01-29 06:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-01-29 06:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288 to the API
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR75288>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-01-29T16:35:40Z',
'fuel_type': 'petrol',
'id': 'a1c94059-c0dc-5c7b-b872-9af3291319e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR75288',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Renault',
'model': 'Captur',
'odometer': 15433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Mild-Hybrid Techno',
'transmission': 'manual',
'trim': 'Techno',
'year': 2023}
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.it] INFO: Saving data for AR75288: {'auction_closing_time': 1769704540.0, 'created_time': 1769458301.93419, 'last_price_update_time': 1769666515.000849}
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR75288') HTTP/1.1" 204 0
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC94766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP83347> (referer: https://www.auto1.com/v1/car-details-view/JP83347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX93574> (referer: https://www.auto1.com/v1/car-details-view/XX93574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW51000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS38459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF49505> (referer: https://www.auto1.com/v1/car-details-view/JF49505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b with identifier: JP83347
2026-01-29 06:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4fdc96-6942-59ee-a84f-0835f3c6207b with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4fdc96-6942-59ee-a84f-0835f3c6207b with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c4fdc96-6942-59ee-a84f-0835f3c6207b, identifier: JP83347
2026-01-29 06:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b with identifier: JP83347
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b with identifier: JP83347
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo courier' containing 'courier'
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b spider: auto1.it
2026-01-29 06:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5c4fdc96-6942-59ee-a84f-0835f3c6207b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo courier' containing 'courier'
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-29T16:40:02Z',
'fuel_type': 'petrol',
'id': '5c4fdc96-6942-59ee-a84f-0835f3c6207b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP83347',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Ford',
'model': 'Tourneo Courier',
'odometer': 18232,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Tourneo Courier 1.0 EcoBoost Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2024}
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP83347%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.it] INFO: Saving data for JP83347: {'auction_closing_time': 1769704802.0, 'created_time': 1769458193.720872, 'last_price_update_time': 1769666515.433938}
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP83347') HTTP/1.1" 204 0
2026-01-29 06:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3714ede-7433-5465-a2e2-3e71a2829804 with identifier: XX93574
2026-01-29 06:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3714ede-7433-5465-a2e2-3e71a2829804 with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3714ede-7433-5465-a2e2-3e71a2829804 with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3714ede-7433-5465-a2e2-3e71a2829804, identifier: XX93574
2026-01-29 06:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3714ede-7433-5465-a2e2-3e71a2829804 with identifier: XX93574
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3714ede-7433-5465-a2e2-3e71a2829804 with identifier: XX93574
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177134 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
177134
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f3714ede-7433-5465-a2e2-3e71a2829804 spider: auto1.it
2026-01-29 06:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f3714ede-7433-5465-a2e2-3e71a2829804 due to rule: high_mileage_for_country.json, error: 177134 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
177134
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:51:42Z',
'fuel_type': 'diesel',
'id': 'f3714ede-7433-5465-a2e2-3e71a2829804',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX93574',
'listing': 'auction',
'location': 'IT, Feriolo',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 177134,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Advance 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Advance 4Motion BlueMotion',
'year': 2019}
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93574%27 HTTP/1.1" 200 None
2026-01-29 06:01:55 [auto1.it] INFO: Saving data for XX93574: {'auction_closing_time': 1769705502.0, 'created_time': 1769457767.488553, 'last_price_update_time': 1769666515.766803}
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX93574') HTTP/1.1" 204 0
2026-01-29 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ52499> (referer: https://www.auto1.com/v1/car-details-view/EJ52499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505
2026-01-29 06:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with scrape type 2
2026-01-29 06:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5, identifier: JF49505
2026-01-29 06:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505
2026-01-29 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505
2026-01-29 06:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505 to the API
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF49505>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:46:26Z',
'fuel_type': 'petrol',
'id': 'ffe3aa0d-4c21-5aab-b910-a88c102bc4e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF49505',
'listing': 'auction',
'location': 'Napoli',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 96978,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2022}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF49505%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.it] INFO: Saving data for JF49505: {'auction_closing_time': 1769705186.0, 'created_time': 1769458069.675206, 'last_price_update_time': 1769666516.226958}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF49505') HTTP/1.1" 204 0
2026-01-29 06:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499
2026-01-29 06:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e107f2-32d4-5730-a440-9e86282c7956 with scrape type 2
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e107f2-32d4-5730-a440-9e86282c7956 with scrape type 2
2026-01-29 06:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2e107f2-32d4-5730-a440-9e86282c7956, identifier: EJ52499
2026-01-29 06:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499
2026-01-29 06:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499
2026-01-29 06:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499 to the API
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ52499>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:13:30Z',
'fuel_type': 'petrol',
'id': 'e2e107f2-32d4-5730-a440-9e86282c7956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ52499',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 65681,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-05',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2021}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52499%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.it] INFO: Saving data for EJ52499: {'auction_closing_time': 1769703210.0, 'created_time': 1768593641.208731, 'last_price_update_time': 1769666516.735978}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ52499') HTTP/1.1" 204 0
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY49338> (referer: https://www.auto1.com/v1/car-details-view/VY49338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW74392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY06074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML77651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY21953> (referer: https://www.auto1.com/v1/car-details-view/AY21953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338
2026-01-29 06:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ee123f-68d8-5be3-b187-f7667e024346 with scrape type 2
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ee123f-68d8-5be3-b187-f7667e024346 with scrape type 2
2026-01-29 06:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 08ee123f-68d8-5be3-b187-f7667e024346, identifier: VY49338
2026-01-29 06:01:56 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338
2026-01-29 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338
2026-01-29 06:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338 to the API
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VY49338>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2026-01-29T16:08:38Z',
'fuel_type': 'hybrid',
'id': '08ee123f-68d8-5be3-b187-f7667e024346',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY49338',
'listing': 'auction',
'location': 'IT, Roma (RM)',
'make': 'Renault',
'model': 'Captur',
'odometer': 60675,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2022}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY49338%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Saving data for VY49338: {'auction_closing_time': 1769702918.0, 'created_time': 1769458343.106823, 'last_price_update_time': 1769666517.393426}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY49338') HTTP/1.1" 204 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: EZ99930
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ99930%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for EZ99930: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: SD18142
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18142%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for SD18142: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: XL62613
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL62613%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for XL62613: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: VK27211
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK27211%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for VK27211: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: AD68193
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD68193%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for AD68193: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: KE54965
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE54965%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for KE54965: 2
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: ZX13232
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX13232%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for ZX13232: 2
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML60826> (referer: https://www.auto1.com/v1/car-details-view/ML60826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB20175> (referer: https://www.auto1.com/v1/car-details-view/SB20175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953
2026-01-29 06:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e34844f-c35a-5a93-90c1-c41953f35416 with scrape type 2
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e34844f-c35a-5a93-90c1-c41953f35416 with scrape type 2
2026-01-29 06:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e34844f-c35a-5a93-90c1-c41953f35416, identifier: AY21953
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: BM05081
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM05081%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for BM05081: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: BD24207
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD24207%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for BD24207: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: JW94842
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW94842%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for JW94842: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: DG99374
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG99374%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for DG99374: 0
2026-01-29 06:01:57 [auto1.it] INFO: Found listing with ID: KV39330
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39330%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.it] INFO: Scrape type for KV39330: 2
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953
2026-01-29 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953
2026-01-29 06:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953 to the API
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY21953>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:26:36Z',
'fuel_type': 'petrol',
'id': '5e34844f-c35a-5a93-90c1-c41953f35416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY21953',
'listing': 'auction',
'location': 'IT, Piacenza',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 144707,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21953%27 HTTP/1.1" 200 None
2026-01-29 06:01:58 [auto1.it] INFO: Saving data for AY21953: {'auction_closing_time': 1769703996.0, 'created_time': 1769458073.371229, 'last_price_update_time': 1769666518.235781}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY21953') HTTP/1.1" 204 0
2026-01-29 06:01:58 [auto1.it] INFO: Found listing with ID: RR19391
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR19391%27 HTTP/1.1" 200 None
2026-01-29 06:01:58 [auto1.it] INFO: Scrape type for RR19391: 0
2026-01-29 06:01:58 [auto1.it] INFO: Found listing with ID: NR38065
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR38065%27 HTTP/1.1" 200 None
2026-01-29 06:01:58 [auto1.it] INFO: Scrape type for NR38065: 2
2026-01-29 06:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826
2026-01-29 06:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with scrape type 2
2026-01-29 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with scrape type 2
2026-01-29 06:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b, identifier: ML60826
2026-01-29 06:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf118e3-ab31-575a-9d1b-2c373d0029eb with identifier: SB20175
2026-01-29 06:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf118e3-ab31-575a-9d1b-2c373d0029eb with scrape type 2
2026-01-29 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf118e3-ab31-575a-9d1b-2c373d0029eb with scrape type 2
2026-01-29 06:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbf118e3-ab31-575a-9d1b-2c373d0029eb, identifier: SB20175
2026-01-29 06:01:58 [auto1.it] INFO: Found listing with ID: ZL05088
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL05088%27 HTTP/1.1" 200 None
2026-01-29 06:01:58 [auto1.it] INFO: Scrape type for ZL05088: 2
2026-01-29 06:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826
2026-01-29 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826
2026-01-29 06:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826 to the API
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML60826>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-29T16:45:33Z',
'fuel_type': 'diesel',
'id': 'c395d78e-9399-5cc8-9cd2-e8ba507b6f0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML60826',
'listing': 'auction',
'location': 'IT, Foggia',
'make': 'Ford',
'model': 'Kuga',
'odometer': 113014,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2020}
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML60826%27 HTTP/1.1" 200 None
2026-01-29 06:01:59 [auto1.it] INFO: Saving data for ML60826: {'auction_closing_time': 1769705133.0, 'created_time': 1769458463.47277, 'last_price_update_time': 1769666519.758292}
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML60826') HTTP/1.1" 204 0
2026-01-29 06:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbf118e3-ab31-575a-9d1b-2c373d0029eb with identifier: SB20175
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbf118e3-ab31-575a-9d1b-2c373d0029eb with identifier: SB20175
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153263 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153263
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bbf118e3-ab31-575a-9d1b-2c373d0029eb spider: auto1.it
2026-01-29 06:02:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bbf118e3-ab31-575a-9d1b-2c373d0029eb due to rule: high_mileage_for_country.json, error: 153263 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153263
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 190,
'expiration_date': '2026-01-29T16:49:42Z',
'fuel_type': 'hybrid',
'id': 'bbf118e3-ab31-575a-9d1b-2c373d0029eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB20175',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 153263,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 VC-T e-POWER Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2022}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB20175%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Saving data for SB20175: {'auction_closing_time': 1769705382.0, 'created_time': 1769458331.928094, 'last_price_update_time': 1769666520.072111}
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB20175') HTTP/1.1" 204 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: YU15778
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU15778%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for YU15778: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: XF74910
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF74910%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for XF74910: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: XK25205
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK25205%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for XK25205: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: TY85783
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY85783%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for TY85783: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: BE54104
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54104%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for BE54104: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: CU67286
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU67286%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for CU67286: 2
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET25388> (referer: https://www.auto1.com/v1/car-details-view/ET25388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ77848> (referer: https://www.auto1.com/v1/car-details-view/SJ77848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB52041> (referer: https://www.auto1.com/v1/car-details-view/TB52041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT72404> (referer: https://www.auto1.com/v1/car-details-view/FT72404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG40810> (referer: https://www.auto1.com/v1/car-details-view/EG40810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD03373> (referer: https://www.auto1.com/v1/car-details-view/AD03373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: VB04552
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for VB04552: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: MV48827
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV48827%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for MV48827: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: UH29837
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH29837%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for UH29837: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: BB04771
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB04771%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for BB04771: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: UW70389
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW70389%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for UW70389: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: AK97065
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK97065%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for AK97065: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: HG59562
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG59562%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for HG59562: 0
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: UL75822
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL75822%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for UL75822: 2
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: GH67198
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH67198%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for GH67198: 2
2026-01-29 06:02:00 [auto1.it] INFO: Found listing with ID: SL36672
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL36672%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [auto1.it] INFO: Scrape type for SL36672: 2
2026-01-29 06:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388
2026-01-29 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 023fb0bc-1406-518c-a2e7-c65bb6238be5 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 023fb0bc-1406-518c-a2e7-c65bb6238be5 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 023fb0bc-1406-518c-a2e7-c65bb6238be5, identifier: ET25388
2026-01-29 06:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb0bf675-045c-55bf-92fe-504461fd6d4c with identifier: SJ77848
2026-01-29 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb0bf675-045c-55bf-92fe-504461fd6d4c with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb0bf675-045c-55bf-92fe-504461fd6d4c with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb0bf675-045c-55bf-92fe-504461fd6d4c, identifier: SJ77848
2026-01-29 06:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041
2026-01-29 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5451a90-56cf-5e3c-874a-c2a6f7999378 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5451a90-56cf-5e3c-874a-c2a6f7999378 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d5451a90-56cf-5e3c-874a-c2a6f7999378, identifier: TB52041
2026-01-29 06:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404
2026-01-29 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61672f30-9c24-5b23-b669-1d55b1b23af4 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61672f30-9c24-5b23-b669-1d55b1b23af4 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61672f30-9c24-5b23-b669-1d55b1b23af4, identifier: FT72404
2026-01-29 06:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810
2026-01-29 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a1e1df-ec29-5258-9c33-81e1a0695744 with scrape type 2
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a1e1df-ec29-5258-9c33-81e1a0695744 with scrape type 2
2026-01-29 06:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3a1e1df-ec29-5258-9c33-81e1a0695744, identifier: EG40810
2026-01-29 06:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373
2026-01-29 06:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e072f5ed-b58e-5ea6-b241-144ee9453283 with scrape type 2
2026-01-29 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e072f5ed-b58e-5ea6-b241-144ee9453283 with scrape type 2
2026-01-29 06:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e072f5ed-b58e-5ea6-b241-144ee9453283, identifier: AD03373
2026-01-29 06:02:01 [auto1.it] INFO: Found listing with ID: KX95898
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX95898%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Scrape type for KX95898: 0
2026-01-29 06:02:01 [auto1.it] INFO: Found listing with ID: WN49537
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN49537%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Scrape type for WN49537: 0
2026-01-29 06:02:01 [auto1.it] INFO: Found listing with ID: JN76838
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN76838%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Scrape type for JN76838: 0
2026-01-29 06:02:01 [auto1.it] INFO: Found listing with ID: ZN65600
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN65600%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Scrape type for ZN65600: 0
2026-01-29 06:02:01 [auto1.it] INFO: Found listing with ID: SW68583
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW68583%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Scrape type for SW68583: 0
2026-01-29 06:02:01 [auto1.it] INFO: Found listing with ID: JE97171
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE97171%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Scrape type for JE97171: 0
2026-01-29 06:02:01 [auto1.it] INFO: Found listing with ID: DA44025
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44025%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Scrape type for DA44025: 2
2026-01-29 06:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388
2026-01-29 06:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388
2026-01-29 06:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388 to the API
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ET25388>
{'auction_title': '',
'c_o_2_emission_value': 178,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 249,
'expiration_date': '2026-01-29T16:58:47Z',
'fuel_type': 'diesel',
'id': '023fb0bc-1406-518c-a2e7-c65bb6238be5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET25388',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Volvo',
'model': 'XC90',
'odometer': 97678,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-14',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Momentum Pro AWD',
'transmission': 'automatic',
'trim': 'Momentum Pro AWD',
'year': 2021}
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET25388%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.it] INFO: Saving data for ET25388: {'auction_closing_time': 1769705927.0, 'created_time': 1769025995.659601, 'last_price_update_time': 1769666521.827213}
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET25388') HTTP/1.1" 204 0
2026-01-29 06:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb0bf675-045c-55bf-92fe-504461fd6d4c with identifier: SJ77848
2026-01-29 06:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb0bf675-045c-55bf-92fe-504461fd6d4c with identifier: SJ77848
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195503 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195503
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bb0bf675-045c-55bf-92fe-504461fd6d4c spider: auto1.it
2026-01-29 06:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bb0bf675-045c-55bf-92fe-504461fd6d4c due to rule: high_mileage_for_country.json, error: 195503 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195503
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-29T16:04:52Z',
'fuel_type': 'diesel',
'id': 'bb0bf675-045c-55bf-92fe-504461fd6d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ77848',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 195503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2020}
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ77848%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.it] INFO: Saving data for SJ77848: {'auction_closing_time': 1769702692.0, 'created_time': 1769457982.489855, 'last_price_update_time': 1769666522.21026}
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ77848') HTTP/1.1" 204 0
2026-01-29 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041
2026-01-29 06:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041 to the API
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB52041>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:29:44Z',
'fuel_type': 'diesel',
'id': 'd5451a90-56cf-5e3c-874a-c2a6f7999378',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB52041',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 142886,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-13',
'seats_number': 7,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB52041%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [auto1.it] INFO: Saving data for TB52041: {'auction_closing_time': 1769704184.0, 'created_time': 1768939590.398004, 'last_price_update_time': 1769666522.559192}
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB52041') HTTP/1.1" 204 0
2026-01-29 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404
2026-01-29 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404
2026-01-29 06:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404 to the API
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FT72404>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 114,
'expiration_date': '2026-01-29T16:52:20Z',
'fuel_type': 'gas',
'id': '61672f30-9c24-5b23-b669-1d55b1b23af4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT72404',
'listing': 'auction',
'location': 'IT, Palermo',
'make': 'DR',
'model': 'DR 4.0',
'odometer': 54818,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 4.0 1.5 LPG',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT72404%27 HTTP/1.1" 200 None
2026-01-29 06:02:03 [auto1.it] INFO: Saving data for FT72404: {'auction_closing_time': 1769705540.0, 'created_time': 1769458407.32214, 'last_price_update_time': 1769666523.052581}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT72404') HTTP/1.1" 204 0
2026-01-29 06:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810
2026-01-29 06:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810
2026-01-29 06:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810 to the API
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG40810>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:45:01Z',
'fuel_type': 'diesel',
'id': 'f3a1e1df-ec29-5258-9c33-81e1a0695744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG40810',
'listing': 'auction',
'location': 'IT, Casamassima',
'make': 'BMW',
'model': 'X1',
'odometer': 112736,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-19',
'seats_number': 4,
'seller_name': None,
'title': 'BMW X1 sDrive 18d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG40810%27 HTTP/1.1" 200 None
2026-01-29 06:02:03 [auto1.it] INFO: Saving data for EG40810: {'auction_closing_time': 1769705101.0, 'created_time': 1769458353.199078, 'last_price_update_time': 1769666523.476271}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG40810') HTTP/1.1" 204 0
2026-01-29 06:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373
2026-01-29 06:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373
2026-01-29 06:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373 to the API
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD03373>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 194,
'expiration_date': '2026-01-29T16:04:51Z',
'fuel_type': 'diesel',
'id': 'e072f5ed-b58e-5ea6-b241-144ee9453283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD03373',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 86620,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2021}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD03373%27 HTTP/1.1" 200 None
2026-01-29 06:02:03 [auto1.it] INFO: Saving data for AD03373: {'auction_closing_time': 1769702691.0, 'created_time': 1769026047.487081, 'last_price_update_time': 1769666523.934792}
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AD03373') HTTP/1.1" 204 0
2026-01-29 06:02:03 [auto1.it] INFO: Found listing with ID: XP01940
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP01940%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.it] INFO: Scrape type for XP01940: 0
2026-01-29 06:02:04 [auto1.it] INFO: Found listing with ID: CD43232
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD43232%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.it] INFO: Scrape type for CD43232: 2
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY47347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC94766> (referer: https://www.auto1.com/v1/car-details-view/NC94766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-01-29 06:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678ab250-2141-5cce-a7ad-2903cb78c4c5 with scrape type 2
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 678ab250-2141-5cce-a7ad-2903cb78c4c5 with scrape type 2
2026-01-29 06:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 678ab250-2141-5cce-a7ad-2903cb78c4c5, identifier: NC94766
2026-01-29 06:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-01-29 06:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-01-29 06:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766 to the API
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NC94766>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-29T16:53:08Z',
'fuel_type': 'hybrid',
'id': '678ab250-2141-5cce-a7ad-2903cb78c4c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC94766',
'listing': 'auction',
'location': 'IT, Palermo',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 37037,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Trend',
'transmission': 'automatic',
'trim': '2WD Trend',
'year': 2022}
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [auto1.it] INFO: Saving data for NC94766: {'auction_closing_time': 1769705588.0, 'created_time': 1769458546.426406, 'last_price_update_time': 1769666524.627053}
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC94766') HTTP/1.1" 204 0
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT57275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD32917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW51000> (referer: https://www.auto1.com/v1/car-details-view/UW51000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK29975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS38459> (referer: https://www.auto1.com/v1/car-details-view/JS38459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000
2026-01-29 06:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with scrape type 2
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with scrape type 2
2026-01-29 06:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e988eac0-5b86-5841-8ad8-467e6ce3f2e0, identifier: UW51000
2026-01-29 06:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000
2026-01-29 06:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000
2026-01-29 06:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000 to the API
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW51000>
{'auction_title': '',
'c_o_2_emission_value': 1,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.3L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:24:03Z',
'fuel_type': 'petrol',
'id': 'e988eac0-5b86-5841-8ad8-467e6ce3f2e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW51000',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 64467,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-16',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.3 TGDi Limited 4x2',
'transmission': 'automatic',
'trim': 'Limited 4x2',
'year': 2018}
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW51000%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [auto1.it] INFO: Saving data for UW51000: {'auction_closing_time': 1769703843.0, 'created_time': 1769458274.251314, 'last_price_update_time': 1769666525.3628}
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW51000') HTTP/1.1" 204 0
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE15416> (referer: https://www.auto1.com/v1/car-details-view/JE15416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459
2026-01-29 06:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b, identifier: JS38459
2026-01-29 06:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459
2026-01-29 06:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459
2026-01-29 06:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459 to the API
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS38459>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:26:37Z',
'fuel_type': 'diesel',
'id': 'efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS38459',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 17326,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2019}
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS38459%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [auto1.it] INFO: Saving data for JS38459: {'auction_closing_time': 1769703997.0, 'created_time': 1769457997.672237, 'last_price_update_time': 1769666525.842305}
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS38459') HTTP/1.1" 204 0
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE54965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML77651> (referer: https://www.auto1.com/v1/car-details-view/ML77651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416
2026-01-29 06:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35f0081-c6f4-5835-a4c6-470e85808eab with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d35f0081-c6f4-5835-a4c6-470e85808eab with scrape type 2
2026-01-29 06:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d35f0081-c6f4-5835-a4c6-470e85808eab, identifier: JE15416
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416
2026-01-29 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416
2026-01-29 06:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416 to the API
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE15416>
{'auction_title': '',
'c_o_2_emission_value': 199,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 300,
'expiration_date': '2026-01-29T16:33:31Z',
'fuel_type': 'petrol',
'id': 'd35f0081-c6f4-5835-a4c6-470e85808eab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE15416',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 55595,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2022}
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE15416%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [auto1.it] INFO: Saving data for JE15416: {'auction_closing_time': 1769704411.0, 'created_time': 1769026102.86481, 'last_price_update_time': 1769666526.369891}
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE15416') HTTP/1.1" 204 0
2026-01-29 06:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU67286/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL05088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651
2026-01-29 06:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with scrape type 2
2026-01-29 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with scrape type 2
2026-01-29 06:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59, identifier: ML77651
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651
2026-01-29 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651
2026-01-29 06:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651 to the API
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML77651>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:13:41Z',
'fuel_type': 'petrol',
'id': 'c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML77651',
'listing': 'auction',
'location': 'IT, Como',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 42574,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML77651%27 HTTP/1.1" 200 None
2026-01-29 06:02:07 [auto1.it] INFO: Saving data for ML77651: {'auction_closing_time': 1769703221.0, 'created_time': 1769458347.945427, 'last_price_update_time': 1769666527.045754}
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML77651') HTTP/1.1" 204 0
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW74392> (referer: https://www.auto1.com/v1/car-details-view/XW74392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR38065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY06074> (referer: https://www.auto1.com/v1/car-details-view/YY06074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV39330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392
2026-01-29 06:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f44fa3-4830-5dc3-b239-fc067a92eda3 with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f44fa3-4830-5dc3-b239-fc067a92eda3 with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 48f44fa3-4830-5dc3-b239-fc067a92eda3, identifier: XW74392
2026-01-29 06:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392
2026-01-29 06:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392
2026-01-29 06:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392 to the API
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XW74392>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:39:09Z',
'fuel_type': 'petrol',
'id': '48f44fa3-4830-5dc3-b239-fc067a92eda3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW74392',
'listing': 'auction',
'location': 'Gallarate',
'make': 'Peugeot',
'model': '2008',
'odometer': 27016,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Active Pack',
'transmission': 'automatic',
'trim': 'Active Pack',
'year': 2021}
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW74392%27 HTTP/1.1" 200 None
2026-01-29 06:02:07 [auto1.it] INFO: Saving data for XW74392: {'auction_closing_time': 1769704749.0, 'created_time': 1769458381.404918, 'last_price_update_time': 1769666527.75329}
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW74392') HTTP/1.1" 204 0
2026-01-29 06:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA44025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-01-29 06:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with scrape type 2
2026-01-29 06:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b, identifier: YY06074
2026-01-29 06:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-01-29 06:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-01-29 06:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074 to the API
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY06074>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 300,
'expiration_date': '2026-01-29T16:18:06Z',
'fuel_type': 'diesel',
'id': '4d50980f-b7d1-58d5-9381-a4dfc5cedc0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY06074',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 68559,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Velar D300 R-Dynamic S',
'transmission': 'automatic',
'trim': 'R-Dynamic S',
'year': 2020}
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-01-29 06:02:08 [auto1.it] INFO: Saving data for YY06074: {'auction_closing_time': 1769703486.0, 'created_time': 1768507465.139085, 'last_price_update_time': 1769666528.331442}
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY06074') HTTP/1.1" 204 0
2026-01-29 06:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD43232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL36672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY47347> (referer: https://www.auto1.com/v1/car-details-view/WY47347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347
2026-01-29 06:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with scrape type 2
2026-01-29 06:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with scrape type 2
2026-01-29 06:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96a09505-4f22-555c-a3e2-d8b1b9a6a306, identifier: WY47347
2026-01-29 06:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-01-29 06:02:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347
2026-01-29 06:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347 to the API
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WY47347>
{'auction_title': '',
'c_o_2_emission_value': 183,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 310,
'expiration_date': '2026-01-29T16:40:06Z',
'fuel_type': 'petrol',
'id': '96a09505-4f22-555c-a3e2-d8b1b9a6a306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY47347',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Audi',
'model': 'S3 Sportback',
'odometer': 61552,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Audi S3 Sportback 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2023}
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY47347%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.it] INFO: Saving data for WY47347: {'auction_closing_time': 1769704806.0, 'created_time': 1769458441.504155, 'last_price_update_time': 1769666529.429249}
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY47347') HTTP/1.1" 204 0
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT57275> (referer: https://www.auto1.com/v1/car-details-view/GT57275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH67198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL75822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD32917> (referer: https://www.auto1.com/v1/car-details-view/TD32917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX13232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK29975> (referer: https://www.auto1.com/v1/car-details-view/FK29975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b04f087-0ba1-5816-9d6e-874fa5385209 with identifier: GT57275
2026-01-29 06:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b04f087-0ba1-5816-9d6e-874fa5385209 with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b04f087-0ba1-5816-9d6e-874fa5385209 with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b04f087-0ba1-5816-9d6e-874fa5385209, identifier: GT57275
2026-01-29 06:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b04f087-0ba1-5816-9d6e-874fa5385209 with identifier: GT57275
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b04f087-0ba1-5816-9d6e-874fa5385209 with identifier: GT57275
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
155338
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5b04f087-0ba1-5816-9d6e-874fa5385209 spider: auto1.it
2026-01-29 06:02:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5b04f087-0ba1-5816-9d6e-874fa5385209 due to rule: high_mileage_for_country.json, error: 155338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
155338
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:29:29Z',
'fuel_type': 'diesel',
'id': '5b04f087-0ba1-5816-9d6e-874fa5385209',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT57275',
'listing': 'auction',
'location': 'IT, Taranto',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 155338,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT57275%27 HTTP/1.1" 200 None
2026-01-29 06:02:09 [auto1.it] INFO: Saving data for GT57275: {'auction_closing_time': 1769704169.0, 'created_time': 1769458279.924436, 'last_price_update_time': 1769666529.937999}
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT57275') HTTP/1.1" 204 0
2026-01-29 06:02:10 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917
2026-01-29 06:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af16906b-b96f-5df7-9097-c83a0d205c08 with scrape type 2
2026-01-29 06:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af16906b-b96f-5df7-9097-c83a0d205c08 with scrape type 2
2026-01-29 06:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af16906b-b96f-5df7-9097-c83a0d205c08, identifier: TD32917
2026-01-29 06:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975
2026-01-29 06:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 780cb0b2-c560-5613-909e-67107024ab36 with scrape type 2
2026-01-29 06:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 780cb0b2-c560-5613-909e-67107024ab36 with scrape type 2
2026-01-29 06:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 780cb0b2-c560-5613-909e-67107024ab36, identifier: FK29975
2026-01-29 06:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917
2026-01-29 06:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917 to the API
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TD32917>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:22:02Z',
'fuel_type': 'petrol',
'id': 'af16906b-b96f-5df7-9097-c83a0d205c08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD32917',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 33572,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
'transmission': 'manual',
'trim': 'SportLine',
'year': 2023}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD32917%27 HTTP/1.1" 200 None
2026-01-29 06:02:10 [auto1.it] INFO: Saving data for TD32917: {'auction_closing_time': 1769703722.0, 'created_time': 1768075373.387265, 'last_price_update_time': 1769666530.831272}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD32917') HTTP/1.1" 204 0
2026-01-29 06:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975
2026-01-29 06:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975 to the API
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FK29975>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-01-29T16:44:38Z',
'fuel_type': 'petrol',
'id': '780cb0b2-c560-5613-909e-67107024ab36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK29975',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Jeep',
'model': 'Compass',
'odometer': 134601,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Longitude FWD',
'transmission': 'manual',
'trim': 'Longitude FWD',
'year': 2019}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK29975%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Saving data for FK29975: {'auction_closing_time': 1769705078.0, 'created_time': 1768593677.701927, 'last_price_update_time': 1769666531.23847}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK29975') HTTP/1.1" 204 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: FX49357
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX49357%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for FX49357: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: AV71014
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV71014%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for AV71014: 2
2026-01-29 06:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG87196> (referer: https://www.auto1.com/v1/car-details-view/SG87196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: UF13738
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for UF13738: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: DP80955
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP80955%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for DP80955: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: AV65430
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV65430%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for AV65430: 2
2026-01-29 06:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: HW92589
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW92589%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for HW92589: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: FW48614
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW48614%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for FW48614: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: UD04779
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD04779%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for UD04779: 2
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: EF33407
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF33407%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for EF33407: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: DT68594
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT68594%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for DT68594: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: BN48518
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for BN48518: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: JY28433
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY28433%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for JY28433: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: CE73370
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE73370%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for CE73370: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: EA43401
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA43401%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for EA43401: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: LZ66498
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ66498%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for LZ66498: 0
2026-01-29 06:02:11 [auto1.it] INFO: Found listing with ID: RN67455
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN67455%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.it] INFO: Scrape type for RN67455: 2
2026-01-29 06:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196
2026-01-29 06:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8841630-1e22-5a95-997d-83beeb9915b4 with scrape type 2
2026-01-29 06:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8841630-1e22-5a95-997d-83beeb9915b4 with scrape type 2
2026-01-29 06:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8841630-1e22-5a95-997d-83beeb9915b4, identifier: SG87196
2026-01-29 06:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196
2026-01-29 06:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196
2026-01-29 06:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196 to the API
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SG87196>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-29T16:46:25Z',
'fuel_type': 'petrol',
'id': 'a8841630-1e22-5a95-997d-83beeb9915b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG87196',
'listing': 'auction',
'location': 'IT, Rocca di Papa',
'make': 'Ford',
'model': 'Puma',
'odometer': 97081,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2021}
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG87196%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Saving data for SG87196: {'auction_closing_time': 1769705185.0, 'created_time': 1769458336.126488, 'last_price_update_time': 1769666532.106513}
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG87196') HTTP/1.1" 204 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: UN61928
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN61928%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for UN61928: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: ZK76849
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK76849%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for ZK76849: 2
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: RZ04126
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ04126%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for RZ04126: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: HW64559
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for HW64559: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: NL17147
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL17147%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for NL17147: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: BP77320
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP77320%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for BP77320: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: WA67831
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA67831%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for WA67831: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: SA07653
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA07653%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for SA07653: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: GC79469
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC79469%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for GC79469: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: LB98702
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB98702%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for LB98702: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: PM18246
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for PM18246: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: HB24915
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB24915%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for HB24915: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: EJ52665
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52665%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for EJ52665: 2
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV39330> (referer: https://www.auto1.com/v1/car-details-view/KV39330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL05088> (referer: https://www.auto1.com/v1/car-details-view/ZL05088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG37801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA44025> (referer: https://www.auto1.com/v1/car-details-view/DA44025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR38065> (referer: https://www.auto1.com/v1/car-details-view/NR38065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: WR93910
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR93910%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for WR93910: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: WK84125
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK84125%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for WK84125: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: XM03029
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for XM03029: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: CA13828
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA13828%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for CA13828: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: RW40398
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW40398%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for RW40398: 2
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: VH04520
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH04520%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for VH04520: 2
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: FF86857
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF86857%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for FF86857: 0
2026-01-29 06:02:12 [auto1.it] INFO: Found listing with ID: HG00560
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG00560%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [auto1.it] INFO: Scrape type for HG00560: 2
2026-01-29 06:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330
2026-01-29 06:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c5fc905-c2ee-5ccc-a62a-23438572850d with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c5fc905-c2ee-5ccc-a62a-23438572850d with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0c5fc905-c2ee-5ccc-a62a-23438572850d, identifier: KV39330
2026-01-29 06:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088
2026-01-29 06:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfca9ace-3a78-5143-90c6-6182600a8904 with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfca9ace-3a78-5143-90c6-6182600a8904 with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dfca9ace-3a78-5143-90c6-6182600a8904, identifier: ZL05088
2026-01-29 06:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025
2026-01-29 06:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with scrape type 2
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with scrape type 2
2026-01-29 06:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b, identifier: DA44025
2026-01-29 06:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065
2026-01-29 06:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36640f4d-5f28-542f-9050-947e32237496 with scrape type 2
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36640f4d-5f28-542f-9050-947e32237496 with scrape type 2
2026-01-29 06:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36640f4d-5f28-542f-9050-947e32237496, identifier: NR38065
2026-01-29 06:02:13 [auto1.it] INFO: Found listing with ID: MJ74552
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ74552%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.it] INFO: Scrape type for MJ74552: 0
2026-01-29 06:02:13 [auto1.it] INFO: Found listing with ID: XS62284
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS62284%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.it] INFO: Scrape type for XS62284: 0
2026-01-29 06:02:13 [auto1.it] INFO: Found listing with ID: AV95910
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV95910%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.it] INFO: Scrape type for AV95910: 0
2026-01-29 06:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330
2026-01-29 06:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330
2026-01-29 06:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330 to the API
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV39330>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:55:00Z',
'fuel_type': 'petrol',
'id': '0c5fc905-c2ee-5ccc-a62a-23438572850d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV39330',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 55221,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39330%27 HTTP/1.1" 200 None
2026-01-29 06:02:13 [auto1.it] INFO: Saving data for KV39330: {'auction_closing_time': 1769705700.0, 'created_time': 1769112379.378631, 'last_price_update_time': 1769666533.617093}
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KV39330') HTTP/1.1" 204 0
2026-01-29 06:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088
2026-01-29 06:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088
2026-01-29 06:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088 to the API
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL05088>
{'auction_title': '',
'c_o_2_emission_value': 224,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-01-29T16:33:27Z',
'fuel_type': 'diesel',
'id': 'dfca9ace-3a78-5143-90c6-6182600a8904',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL05088',
'listing': 'auction',
'location': 'Treviolo',
'make': 'GWM',
'model': 'H6',
'odometer': 43421,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'GWM H6 2.0 Turbodiesel One 2WD',
'transmission': 'manual',
'trim': 'One 2WD',
'year': 2022}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL05088%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.it] INFO: Saving data for ZL05088: {'auction_closing_time': 1769704407.0, 'created_time': 1769458130.996762, 'last_price_update_time': 1769666534.075256}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZL05088') HTTP/1.1" 204 0
2026-01-29 06:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025
2026-01-29 06:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025
2026-01-29 06:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025 to the API
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA44025>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 184,
'expiration_date': '2026-01-29T16:43:17Z',
'fuel_type': 'hybrid',
'id': '6e1e0932-9406-58e8-8abf-6f2f6099ba7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA44025',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Lexus',
'model': 'UX-Serie',
'odometer': 68128,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-21',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus UX-Serie UX 250h Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44025%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.it] INFO: Saving data for DA44025: {'auction_closing_time': 1769704997.0, 'created_time': 1769458080.471993, 'last_price_update_time': 1769666534.557202}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA44025') HTTP/1.1" 204 0
2026-01-29 06:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065
2026-01-29 06:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065
2026-01-29 06:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065 to the API
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NR38065>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-29T16:44:33Z',
'fuel_type': 'petrol',
'id': '36640f4d-5f28-542f-9050-947e32237496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR38065',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 46424,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2022}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR38065%27 HTTP/1.1" 200 None
2026-01-29 06:02:14 [auto1.it] INFO: Saving data for NR38065: {'auction_closing_time': 1769705073.0, 'created_time': 1768248048.788999, 'last_price_update_time': 1769666534.960595}
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR38065') HTTP/1.1" 204 0
2026-01-29 06:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL36672> (referer: https://www.auto1.com/v1/car-details-view/SL36672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672
2026-01-29 06:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf29ab44-de37-5347-8e30-53df43a8966e with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf29ab44-de37-5347-8e30-53df43a8966e with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf29ab44-de37-5347-8e30-53df43a8966e, identifier: SL36672
2026-01-29 06:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672
2026-01-29 06:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672
2026-01-29 06:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672 to the API
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL36672>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:57:41Z',
'fuel_type': 'diesel',
'id': 'bf29ab44-de37-5347-8e30-53df43a8966e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL36672',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Audi',
'model': 'Q3',
'odometer': 86657,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2019}
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL36672%27 HTTP/1.1" 200 None
2026-01-29 06:02:15 [auto1.it] INFO: Saving data for SL36672: {'auction_closing_time': 1769705861.0, 'created_time': 1769025935.68702, 'last_price_update_time': 1769666535.549283}
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SL36672') HTTP/1.1" 204 0
2026-01-29 06:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY58438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD39232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG75193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL92988> (referer: https://www.auto1.com/v1/car-details-view/CL92988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD43232> (referer: https://www.auto1.com/v1/car-details-view/CD43232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988
2026-01-29 06:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b03466-c0af-5c66-b509-0906e6505589 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b03466-c0af-5c66-b509-0906e6505589 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3b03466-c0af-5c66-b509-0906e6505589, identifier: CL92988
2026-01-29 06:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232
2026-01-29 06:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d334aba-5ef8-5cd9-b891-843e39c74899 with scrape type 2
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d334aba-5ef8-5cd9-b891-843e39c74899 with scrape type 2
2026-01-29 06:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d334aba-5ef8-5cd9-b891-843e39c74899, identifier: CD43232
2026-01-29 06:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988
2026-01-29 06:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988
2026-01-29 06:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988 to the API
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CL92988>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 122,
'expiration_date': '2026-01-29T16:39:22Z',
'fuel_type': 'petrol',
'id': 'd3b03466-c0af-5c66-b509-0906e6505589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL92988',
'listing': 'auction',
'location': 'IT, Segrate',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 113165,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL92988%27 HTTP/1.1" 200 None
2026-01-29 06:02:16 [auto1.it] INFO: Saving data for CL92988: {'auction_closing_time': 1769704762.0, 'created_time': 1769457988.602069, 'last_price_update_time': 1769666536.472496}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CL92988') HTTP/1.1" 204 0
2026-01-29 06:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232
2026-01-29 06:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232
2026-01-29 06:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232 to the API
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD43232>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-29T16:02:04Z',
'fuel_type': 'diesel',
'id': '5d334aba-5ef8-5cd9-b891-843e39c74899',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD43232',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 117245,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi S-Edition',
'transmission': 'manual',
'trim': 'S-Edition',
'year': 2019}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD43232%27 HTTP/1.1" 200 None
2026-01-29 06:02:16 [auto1.it] INFO: Saving data for CD43232: {'auction_closing_time': 1769702524.0, 'created_time': 1769458340.349053, 'last_price_update_time': 1769666536.920265}
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD43232') HTTP/1.1" 204 0
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA81726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU67286> (referer: https://www.auto1.com/v1/car-details-view/CU67286/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286
2026-01-29 06:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c517a10-fd07-5b95-b540-c0692eb5c6be with scrape type 2
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c517a10-fd07-5b95-b540-c0692eb5c6be with scrape type 2
2026-01-29 06:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c517a10-fd07-5b95-b540-c0692eb5c6be, identifier: CU67286
2026-01-29 06:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286
2026-01-29 06:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286 to the API
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU67286>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 155,
'expiration_date': '2026-01-29T16:20:03Z',
'fuel_type': 'petrol',
'id': '7c517a10-fd07-5b95-b540-c0692eb5c6be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU67286',
'listing': 'auction',
'location': 'Milano',
'make': 'Ford',
'model': 'Focus',
'odometer': 66769,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2021}
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU67286%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [auto1.it] INFO: Saving data for CU67286: {'auction_closing_time': 1769703603.0, 'created_time': 1769458448.89961, 'last_price_update_time': 1769666537.538713}
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU67286') HTTP/1.1" 204 0
2026-01-29 06:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE54965> (referer: https://www.auto1.com/v1/car-details-view/KE54965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd70160-cf32-5264-8ad0-7701a4a36a58 with identifier: KE54965
2026-01-29 06:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd70160-cf32-5264-8ad0-7701a4a36a58 with scrape type 2
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdd70160-cf32-5264-8ad0-7701a4a36a58 with scrape type 2
2026-01-29 06:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fdd70160-cf32-5264-8ad0-7701a4a36a58, identifier: KE54965
2026-01-29 06:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fdd70160-cf32-5264-8ad0-7701a4a36a58 with identifier: KE54965
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fdd70160-cf32-5264-8ad0-7701a4a36a58 with identifier: KE54965
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2026-01-29 06:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fdd70160-cf32-5264-8ad0-7701a4a36a58 spider: auto1.it
2026-01-29 06:02:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fdd70160-cf32-5264-8ad0-7701a4a36a58 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
'c_o_2_emission_value': 183,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:38:31Z',
'fuel_type': 'diesel',
'id': 'fdd70160-cf32-5264-8ad0-7701a4a36a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE54965',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 25710,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-23',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Club XS',
'transmission': 'manual',
'trim': 'Club XS',
'year': 2021}
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE54965%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.it] INFO: Saving data for KE54965: {'auction_closing_time': 1769704711.0, 'created_time': 1768507535.774277, 'last_price_update_time': 1769666538.019673}
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE54965') HTTP/1.1" 204 0
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD04779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK76849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV71014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN67455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX13232> (referer: https://www.auto1.com/v1/car-details-view/ZX13232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with identifier: ZX13232
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f, identifier: ZX13232
2026-01-29 06:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with identifier: ZX13232
2026-01-29 06:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with identifier: ZX13232
2026-01-29 06:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 138389 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
138389
2026-01-29 06:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f spider: auto1.it
2026-01-29 06:02:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f due to rule: high_mileage_for_make.json, error: 138389 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
138389
{'auction_title': '',
'c_o_2_emission_value': 198,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 280,
'expiration_date': '2026-01-29T16:57:52Z',
'fuel_type': 'petrol',
'id': 'f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX13232',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 138389,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.0 Turbo Veloce Q4',
'transmission': 'automatic',
'trim': 'Veloce Q4',
'year': 2022}
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX13232%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [auto1.it] INFO: Saving data for ZX13232: {'auction_closing_time': 1769705872.0, 'created_time': 1767816753.74687, 'last_price_update_time': 1769666538.80365}
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX13232') HTTP/1.1" 204 0
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV65430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG37801> (referer: https://www.auto1.com/v1/car-details-view/EG37801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL75822> (referer: https://www.auto1.com/v1/car-details-view/UL75822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW40398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870e78e5-ab23-51a8-82b1-d23cd94548cb with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 870e78e5-ab23-51a8-82b1-d23cd94548cb with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 870e78e5-ab23-51a8-82b1-d23cd94548cb, identifier: EG37801
2026-01-29 06:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-01-29 06:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-01-29 06:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801 to the API
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG37801>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-29T16:45:34Z',
'fuel_type': 'petrol',
'id': '870e78e5-ab23-51a8-82b1-d23cd94548cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG37801',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'make': 'DR',
'model': 'DR 3',
'odometer': 70363,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 3 1.5',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [auto1.it] INFO: Saving data for EG37801: {'auction_closing_time': 1769705134.0, 'created_time': 1769458280.277102, 'last_price_update_time': 1769666539.494979}
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG37801') HTTP/1.1" 204 0
2026-01-29 06:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with identifier: UL75822
2026-01-29 06:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f758e2f0-5518-50f2-b08e-5dd10e3c6f11, identifier: UL75822
2026-01-29 06:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG00560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with identifier: UL75822
2026-01-29 06:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with identifier: UL75822
2026-01-29 06:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165157 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165157
2026-01-29 06:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 spider: auto1.it
2026-01-29 06:02:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 due to rule: high_mileage_for_country.json, error: 165157 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165157
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-01-29T16:53:50Z',
'fuel_type': 'diesel',
'id': 'f758e2f0-5518-50f2-b08e-5dd10e3c6f11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL75822',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'BMW',
'model': 'X5',
'odometer': 165157,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL75822%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.it] INFO: Saving data for UL75822: {'auction_closing_time': 1769705630.0, 'created_time': 1769025969.181828, 'last_price_update_time': 1769666540.005655}
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL75822') HTTP/1.1" 204 0
2026-01-29 06:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH04520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ52665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH67198> (referer: https://www.auto1.com/v1/car-details-view/GH67198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198
2026-01-29 06:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d614629a-03c0-56b5-a30f-bb6cf687bb87 with scrape type 2
2026-01-29 06:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d614629a-03c0-56b5-a30f-bb6cf687bb87 with scrape type 2
2026-01-29 06:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d614629a-03c0-56b5-a30f-bb6cf687bb87, identifier: GH67198
2026-01-29 06:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198
2026-01-29 06:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198
2026-01-29 06:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198 to the API
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GH67198>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-01-29T16:47:10Z',
'fuel_type': 'diesel',
'id': 'd614629a-03c0-56b5-a30f-bb6cf687bb87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH67198',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 42777,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Business',
'transmission': 'automatic',
'trim': '4Matic Business',
'year': 2019}
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH67198%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.it] INFO: Saving data for GH67198: {'auction_closing_time': 1769705230.0, 'created_time': 1768464057.45225, 'last_price_update_time': 1769666540.959712}
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GH67198') HTTP/1.1" 204 0
2026-01-29 06:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY58438> (referer: https://www.auto1.com/v1/car-details-view/PY58438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA81726> (referer: https://www.auto1.com/v1/car-details-view/UA81726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG75193> (referer: https://www.auto1.com/v1/car-details-view/FG75193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD39232> (referer: https://www.auto1.com/v1/car-details-view/RD39232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK76849> (referer: https://www.auto1.com/v1/car-details-view/ZK76849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD04779> (referer: https://www.auto1.com/v1/car-details-view/UD04779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:21 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with identifier: PY58438
2026-01-29 06:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with scrape type 2
2026-01-29 06:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with scrape type 2
2026-01-29 06:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6, identifier: PY58438
2026-01-29 06:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with identifier: PY58438
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with identifier: PY58438
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 spider: auto1.it
2026-01-29 06:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-01-29T16:37:00Z',
'fuel_type': 'petrol',
'id': 'c1423c4b-ec0b-5cd9-a420-d3dc5866cff6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY58438',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': 'Panda',
'odometer': 58,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-05-15',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58438%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.it] INFO: Saving data for PY58438: {'auction_closing_time': 1769704620.0, 'created_time': 1769026118.487316, 'last_price_update_time': 1769666541.562251}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PY58438') HTTP/1.1" 204 0
2026-01-29 06:02:21 [auto1.it] INFO: Found listing with ID: LX29596
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX29596%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.it] INFO: Scrape type for LX29596: 0
2026-01-29 06:02:21 [auto1.it] INFO: Found listing with ID: YL06979
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL06979%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.it] INFO: Scrape type for YL06979: 0
2026-01-29 06:02:21 [auto1.it] INFO: Found listing with ID: ES54295
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES54295%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.it] INFO: Scrape type for ES54295: 0
2026-01-29 06:02:21 [auto1.it] INFO: Found listing with ID: SL26814
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL26814%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.it] INFO: Scrape type for SL26814: 2
2026-01-29 06:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726
2026-01-29 06:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc25b93-47f7-596c-94df-409439a75cc6 with scrape type 2
2026-01-29 06:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc25b93-47f7-596c-94df-409439a75cc6 with scrape type 2
2026-01-29 06:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbc25b93-47f7-596c-94df-409439a75cc6, identifier: UA81726
2026-01-29 06:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193
2026-01-29 06:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with scrape type 2
2026-01-29 06:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with scrape type 2
2026-01-29 06:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0, identifier: FG75193
2026-01-29 06:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232
2026-01-29 06:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d06c2057-cdfc-5676-a287-b5564f080177 with scrape type 2
2026-01-29 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d06c2057-cdfc-5676-a287-b5564f080177 with scrape type 2
2026-01-29 06:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d06c2057-cdfc-5676-a287-b5564f080177, identifier: RD39232
2026-01-29 06:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849
2026-01-29 06:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c973523-6790-5459-9ec6-7f37371d516b with scrape type 2
2026-01-29 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c973523-6790-5459-9ec6-7f37371d516b with scrape type 2
2026-01-29 06:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c973523-6790-5459-9ec6-7f37371d516b, identifier: ZK76849
2026-01-29 06:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3517a92c-88ca-5494-b2f3-492d36799fa1 with identifier: UD04779
2026-01-29 06:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3517a92c-88ca-5494-b2f3-492d36799fa1 with scrape type 2
2026-01-29 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3517a92c-88ca-5494-b2f3-492d36799fa1 with scrape type 2
2026-01-29 06:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3517a92c-88ca-5494-b2f3-492d36799fa1, identifier: UD04779
2026-01-29 06:02:22 [auto1.it] INFO: Found listing with ID: FR59611
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR59611%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Scrape type for FR59611: 0
2026-01-29 06:02:22 [auto1.it] INFO: Found listing with ID: WV97974
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV97974%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Scrape type for WV97974: 0
2026-01-29 06:02:22 [auto1.it] INFO: Found listing with ID: NF00160
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF00160%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Scrape type for NF00160: 0
2026-01-29 06:02:22 [auto1.it] INFO: Found listing with ID: NF51505
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF51505%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Scrape type for NF51505: 0
2026-01-29 06:02:22 [auto1.it] INFO: Found listing with ID: SS94947
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Scrape type for SS94947: 0
2026-01-29 06:02:22 [auto1.it] INFO: Found listing with ID: RJ83517
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ83517%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Scrape type for RJ83517: 0
2026-01-29 06:02:22 [auto1.it] INFO: Found listing with ID: NR13454
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR13454%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Scrape type for NR13454: 2
2026-01-29 06:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726
2026-01-29 06:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726
2026-01-29 06:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726 to the API
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA81726>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:51:31Z',
'fuel_type': 'diesel',
'id': 'bbc25b93-47f7-596c-94df-409439a75cc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA81726',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 54715,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.it] INFO: Saving data for UA81726: {'auction_closing_time': 1769705491.0, 'created_time': 1768507638.805556, 'last_price_update_time': 1769666542.894545}
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA81726') HTTP/1.1" 204 0
2026-01-29 06:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193
2026-01-29 06:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193
2026-01-29 06:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193 to the API
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG75193>
{'auction_title': '',
'c_o_2_emission_value': 49,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 306,
'expiration_date': '2026-01-29T16:12:51Z',
'fuel_type': 'hybrid',
'id': '1236750b-b0fa-516e-9e24-bb9a5a18f1b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG75193',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 90907,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-05',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2021}
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG75193%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.it] INFO: Saving data for FG75193: {'auction_closing_time': 1769703171.0, 'created_time': 1768248365.153934, 'last_price_update_time': 1769666543.402577}
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FG75193') HTTP/1.1" 204 0
2026-01-29 06:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232
2026-01-29 06:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232
2026-01-29 06:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232 to the API
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD39232>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-29T16:39:03Z',
'fuel_type': 'petrol',
'id': 'd06c2057-cdfc-5676-a287-b5564f080177',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD39232',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volvo',
'model': 'XC40',
'odometer': 77078,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 2.0 T4 R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2019}
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD39232%27 HTTP/1.1" 200 None
2026-01-29 06:02:23 [auto1.it] INFO: Saving data for RD39232: {'auction_closing_time': 1769704743.0, 'created_time': 1769458079.532569, 'last_price_update_time': 1769666543.757592}
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD39232') HTTP/1.1" 204 0
2026-01-29 06:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849
2026-01-29 06:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849
2026-01-29 06:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849 to the API
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK76849>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 118,
'expiration_date': '2026-01-29T16:12:32Z',
'fuel_type': 'gas',
'id': '1c973523-6790-5459-9ec6-7f37371d516b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK76849',
'listing': 'auction',
'location': 'IT, Beinasco',
'make': 'EVO',
'model': '5',
'odometer': 75918,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'EVO 5 1.6 LPG',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK76849%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Saving data for ZK76849: {'auction_closing_time': 1769703152.0, 'created_time': 1769112505.427908, 'last_price_update_time': 1769666544.087565}
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK76849') HTTP/1.1" 204 0
2026-01-29 06:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3517a92c-88ca-5494-b2f3-492d36799fa1 with identifier: UD04779
2026-01-29 06:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3517a92c-88ca-5494-b2f3-492d36799fa1 with identifier: UD04779
2026-01-29 06:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157338
2026-01-29 06:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3517a92c-88ca-5494-b2f3-492d36799fa1 spider: auto1.it
2026-01-29 06:02:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3517a92c-88ca-5494-b2f3-492d36799fa1 due to rule: high_mileage_for_country.json, error: 157338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157338
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-01-29T16:21:25Z',
'fuel_type': 'diesel',
'id': '3517a92c-88ca-5494-b2f3-492d36799fa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD04779',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 157338,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
'transmission': 'automatic',
'trim': 'Business BlueMotion',
'year': 2019}
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD04779%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Saving data for UD04779: {'auction_closing_time': 1769703685.0, 'created_time': 1768989674.484685, 'last_price_update_time': 1769666544.32528}
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD04779') HTTP/1.1" 204 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: RV64842
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for RV64842: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: EA68503
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for EA68503: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: AF06947
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF06947%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for AF06947: 2
2026-01-29 06:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN67455> (referer: https://www.auto1.com/v1/car-details-view/RN67455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: WM90697
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM90697%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for WM90697: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: LY72233
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY72233%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for LY72233: 2
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: PJ38306
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ38306%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for PJ38306: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: DA91703
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA91703%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for DA91703: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: HH00112
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH00112%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for HH00112: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: ZA06304
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA06304%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for ZA06304: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: ZA57365
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA57365%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for ZA57365: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: XR33042
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR33042%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for XR33042: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: KK65649
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK65649%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for KK65649: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: DC19441
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC19441%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for DC19441: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: EC80373
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC80373%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for EC80373: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: CM86326
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM86326%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for CM86326: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: WZ33226
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ33226%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for WZ33226: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: HY00654
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY00654%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for HY00654: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: UD94632
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD94632%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for UD94632: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: YJ30752
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ30752%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for YJ30752: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: ZD98375
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD98375%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for ZD98375: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: YH36098
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH36098%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for YH36098: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: EZ33602
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ33602%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for EZ33602: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: EA92626
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA92626%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.it] INFO: Scrape type for EA92626: 0
2026-01-29 06:02:24 [auto1.it] INFO: Found listing with ID: MP18514
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP18514%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.it] INFO: Scrape type for MP18514: 0
2026-01-29 06:02:25 [auto1.it] INFO: Found listing with ID: CC90346
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC90346%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.it] INFO: Scrape type for CC90346: 0
2026-01-29 06:02:25 [auto1.it] INFO: Found listing with ID: FN77058
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN77058%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.it] INFO: Scrape type for FN77058: 0
2026-01-29 06:02:25 [auto1.it] INFO: Found listing with ID: TU05159
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU05159%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.it] INFO: Scrape type for TU05159: 0
2026-01-29 06:02:25 [auto1.it] INFO: Found listing with ID: SF76565
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF76565%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.it] INFO: Scrape type for SF76565: 0
2026-01-29 06:02:25 [auto1.it] INFO: Found listing with ID: SF52848
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF52848%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.it] INFO: Scrape type for SF52848: 0
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ52665> (referer: https://www.auto1.com/v1/car-details-view/EJ52665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH04520> (referer: https://www.auto1.com/v1/car-details-view/VH04520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455
2026-01-29 06:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2faed50-c6a6-56d8-bf0e-de98f3dd538a with scrape type 2
2026-01-29 06:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2faed50-c6a6-56d8-bf0e-de98f3dd538a with scrape type 2
2026-01-29 06:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2faed50-c6a6-56d8-bf0e-de98f3dd538a, identifier: RN67455
2026-01-29 06:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455
2026-01-29 06:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455
2026-01-29 06:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455 to the API
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN67455>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-29T16:02:20Z',
'fuel_type': 'petrol',
'id': 'a2faed50-c6a6-56d8-bf0e-de98f3dd538a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN67455',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 109340,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.0 TGDi Limited 4x2',
'transmission': 'manual',
'trim': 'Limited 4x2',
'year': 2019}
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN67455%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.it] INFO: Saving data for RN67455: {'auction_closing_time': 1769702540.0, 'created_time': 1769026126.49655, 'last_price_update_time': 1769666545.684035}
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN67455') HTTP/1.1" 204 0
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV65430> (referer: https://www.auto1.com/v1/car-details-view/AV65430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV71014> (referer: https://www.auto1.com/v1/car-details-view/AV71014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW40398> (referer: https://www.auto1.com/v1/car-details-view/RW40398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG00560> (referer: https://www.auto1.com/v1/car-details-view/HG00560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665
2026-01-29 06:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b407068d-4a68-526e-afbb-c7ee8731fa4f with scrape type 2
2026-01-29 06:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b407068d-4a68-526e-afbb-c7ee8731fa4f with scrape type 2
2026-01-29 06:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b407068d-4a68-526e-afbb-c7ee8731fa4f, identifier: EJ52665
2026-01-29 06:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520
2026-01-29 06:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e8a557-d8a0-5a60-bcf8-227b3274298a with scrape type 2
2026-01-29 06:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e8a557-d8a0-5a60-bcf8-227b3274298a with scrape type 2
2026-01-29 06:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61e8a557-d8a0-5a60-bcf8-227b3274298a, identifier: VH04520
2026-01-29 06:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665
2026-01-29 06:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665
2026-01-29 06:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665 to the API
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ52665>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.3L',
'engine_horse_power': 131,
'expiration_date': '2026-01-29T16:28:06Z',
'fuel_type': 'petrol',
'id': 'b407068d-4a68-526e-afbb-c7ee8731fa4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ52665',
'listing': 'auction',
'location': 'IT, Elmas',
'make': 'Renault',
'model': 'Captur',
'odometer': 78112,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Sport Edition',
'transmission': 'manual',
'trim': 'Sport Edition',
'year': 2019}
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52665%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.it] INFO: Saving data for EJ52665: {'auction_closing_time': 1769704086.0, 'created_time': 1769025921.256866, 'last_price_update_time': 1769666546.451017}
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ52665') HTTP/1.1" 204 0
2026-01-29 06:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520
2026-01-29 06:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520
2026-01-29 06:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520 to the API
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH04520>
{'auction_title': '',
'c_o_2_emission_value': 36,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 309,
'expiration_date': '2026-01-29T16:54:53Z',
'fuel_type': 'hybrid',
'id': '61e8a557-d8a0-5a60-bcf8-227b3274298a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH04520',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 29995,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport P300e Hybrid R-Dynamic SE AWD',
'transmission': 'automatic',
'trim': 'R-Dynamic SE AWD',
'year': 2023}
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH04520%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.it] INFO: Saving data for VH04520: {'auction_closing_time': 1769705693.0, 'created_time': 1769026030.574272, 'last_price_update_time': 1769666546.902742}
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH04520') HTTP/1.1" 204 0
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL26814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f11b9f-3756-538f-9685-0f5cdca5959a with identifier: AV65430
2026-01-29 06:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f11b9f-3756-538f-9685-0f5cdca5959a with scrape type 2
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50f11b9f-3756-538f-9685-0f5cdca5959a with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50f11b9f-3756-538f-9685-0f5cdca5959a, identifier: AV65430
2026-01-29 06:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014
2026-01-29 06:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a11177-772b-5bf8-b834-b833c7d592e2 with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a11177-772b-5bf8-b834-b833c7d592e2 with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85a11177-772b-5bf8-b834-b833c7d592e2, identifier: AV71014
2026-01-29 06:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f16019-4060-572f-ae73-03eab88073aa with identifier: RW40398
2026-01-29 06:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f16019-4060-572f-ae73-03eab88073aa with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f16019-4060-572f-ae73-03eab88073aa with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6f16019-4060-572f-ae73-03eab88073aa, identifier: RW40398
2026-01-29 06:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560
2026-01-29 06:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e21abc-a1cc-5ec9-9b7a-7a780869191e with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13e21abc-a1cc-5ec9-9b7a-7a780869191e with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13e21abc-a1cc-5ec9-9b7a-7a780869191e, identifier: HG00560
2026-01-29 06:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50f11b9f-3756-538f-9685-0f5cdca5959a with identifier: AV65430
2026-01-29 06:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50f11b9f-3756-538f-9685-0f5cdca5959a with identifier: AV65430
2026-01-29 06:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173023 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173023
2026-01-29 06:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 50f11b9f-3756-538f-9685-0f5cdca5959a spider: auto1.it
2026-01-29 06:02:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 50f11b9f-3756-538f-9685-0f5cdca5959a due to rule: high_mileage_for_country.json, error: 173023 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173023
{'auction_title': '',
'c_o_2_emission_value': 183,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-01-29T16:57:11Z',
'fuel_type': 'diesel',
'id': '50f11b9f-3756-538f-9685-0f5cdca5959a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV65430',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'make': 'BMW',
'model': 'X6',
'odometer': 173023,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X6 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV65430%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.it] INFO: Saving data for AV65430: {'auction_closing_time': 1769705831.0, 'created_time': 1769025645.165519, 'last_price_update_time': 1769666547.776279}
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AV65430') HTTP/1.1" 204 0
2026-01-29 06:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014
2026-01-29 06:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014
2026-01-29 06:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014 to the API
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV71014>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 193,
'expiration_date': '2026-01-29T16:29:14Z',
'fuel_type': 'diesel',
'id': '85a11177-772b-5bf8-b834-b833c7d592e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV71014',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 10142,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2024}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV71014%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Saving data for AV71014: {'auction_closing_time': 1769704154.0, 'created_time': 1769458340.000779, 'last_price_update_time': 1769666548.193473}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AV71014') HTTP/1.1" 204 0
2026-01-29 06:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6f16019-4060-572f-ae73-03eab88073aa with identifier: RW40398
2026-01-29 06:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6f16019-4060-572f-ae73-03eab88073aa with identifier: RW40398
2026-01-29 06:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170301 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170301
2026-01-29 06:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c6f16019-4060-572f-ae73-03eab88073aa spider: auto1.it
2026-01-29 06:02:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c6f16019-4060-572f-ae73-03eab88073aa due to rule: high_mileage_for_country.json, error: 170301 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170301
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-01-29T16:20:33Z',
'fuel_type': 'diesel',
'id': 'c6f16019-4060-572f-ae73-03eab88073aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW40398',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 170301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi Xprime ISG 2WD',
'transmission': 'automatic',
'trim': 'Xprime ISG 2WD',
'year': 2018}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW40398%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Saving data for RW40398: {'auction_closing_time': 1769703633.0, 'created_time': 1769458397.696937, 'last_price_update_time': 1769666548.447093}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RW40398') HTTP/1.1" 204 0
2026-01-29 06:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560
2026-01-29 06:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560
2026-01-29 06:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560 to the API
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HG00560>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-29T16:17:08Z',
'fuel_type': 'gas',
'id': '13e21abc-a1cc-5ec9-9b7a-7a780869191e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG00560',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 81444,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG00560%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Saving data for HG00560: {'auction_closing_time': 1769703428.0, 'created_time': 1769457795.431298, 'last_price_update_time': 1769666548.844598}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG00560') HTTP/1.1" 204 0
2026-01-29 06:02:28 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:28 [auto1.it] INFO: Found listing with ID: XR19887
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Scrape type for XR19887: 0
2026-01-29 06:02:28 [auto1.it] INFO: Found listing with ID: TP74360
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP74360%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Scrape type for TP74360: 0
2026-01-29 06:02:28 [auto1.it] INFO: Found listing with ID: GK81526
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK81526%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Scrape type for GK81526: 0
2026-01-29 06:02:28 [auto1.it] INFO: Found listing with ID: TC56605
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC56605%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Scrape type for TC56605: 0
2026-01-29 06:02:28 [auto1.it] INFO: Found listing with ID: TS20335
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS20335%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.it] INFO: Scrape type for TS20335: 0
2026-01-29 06:02:28 [auto1.it] INFO: Found listing with ID: FS42168
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS42168%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for FS42168: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: KF08387
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF08387%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for KF08387: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: RC65604
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC65604%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for RC65604: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: SP33249
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP33249%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for SP33249: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: UD53703
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD53703%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for UD53703: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: RR01200
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR01200%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for RR01200: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: ZX31921
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX31921%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for ZX31921: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: VV30676
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV30676%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for VV30676: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: AP23964
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP23964%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for AP23964: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: PM20896
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM20896%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for PM20896: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: YR95481
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR95481%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for YR95481: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: VS47380
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS47380%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for VS47380: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: YP57818
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP57818%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for YP57818: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: HH59266
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH59266%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for HH59266: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: PM77275
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77275%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for PM77275: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: TJ68491
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ68491%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for TJ68491: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: GZ60590
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for GZ60590: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: CY86412
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY86412%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for CY86412: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: AJ94497
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ94497%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for AJ94497: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: TK24342
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK24342%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for TK24342: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: NJ76886
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ76886%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for NJ76886: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: UZ46554
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ46554%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for UZ46554: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: CK43710
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK43710%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for CK43710: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: XA03649
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA03649%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for XA03649: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: XZ92879
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ92879%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for XZ92879: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: BD65212
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD65212%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for BD65212: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: JN05485
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN05485%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for JN05485: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: YE02110
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE02110%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for YE02110: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: PW84021
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW84021%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for PW84021: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: BM83226
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM83226%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for BM83226: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: RH01953
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH01953%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for RH01953: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: SR88948
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR88948%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for SR88948: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: JY56965
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY56965%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for JY56965: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: PD47677
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD47677%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for PD47677: 0
2026-01-29 06:02:29 [auto1.it] INFO: Found listing with ID: HH72494
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH72494%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.it] INFO: Scrape type for HH72494: 0
2026-01-29 06:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF06947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR13454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY72233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL26814> (referer: https://www.auto1.com/v1/car-details-view/SL26814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: BE15819
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE15819%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for BE15819: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: JG91765
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG91765%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for JG91765: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: GY55011
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for GY55011: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: ED39383
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED39383%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for ED39383: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: BU98469
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU98469%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for BU98469: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: TE90440
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE90440%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for TE90440: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: VL02819
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL02819%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for VL02819: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: CC38555
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC38555%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for CC38555: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: VM43481
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM43481%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.it] INFO: Scrape type for VM43481: 0
2026-01-29 06:02:30 [auto1.it] INFO: Found listing with ID: NP54569
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP54569%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for NP54569: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: PP05492
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP05492%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for PP05492: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: YG15382
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG15382%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for YG15382: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: HU90428
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU90428%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for HU90428: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: AC57291
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC57291%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for AC57291: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: VV31468
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV31468%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for VV31468: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: UP17064
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP17064%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for UP17064: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: YX37505
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX37505%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for YX37505: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: NF03892
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF03892%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for NF03892: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: UD73720
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD73720%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for UD73720: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: CU51863
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU51863%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for CU51863: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: JD87332
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD87332%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for JD87332: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: MG90392
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG90392%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for MG90392: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: YU19851
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU19851%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for YU19851: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: HT79408
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT79408%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for HT79408: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: DA53677
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA53677%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for DA53677: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: BC61751
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC61751%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for BC61751: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: XP18402
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP18402%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for XP18402: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: XX61742
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX61742%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for XX61742: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: XS04727
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS04727%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for XS04727: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: PK36389
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK36389%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for PK36389: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: PM33616
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM33616%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for PM33616: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: KK21064
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK21064%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for KK21064: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: RS56779
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56779%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for RS56779: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: JV90142
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV90142%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for JV90142: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: TL16229
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL16229%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for TL16229: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: CK36923
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK36923%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for CK36923: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: MJ69210
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ69210%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for MJ69210: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: ZT96568
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT96568%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for ZT96568: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: YG51898
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG51898%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for YG51898: 0
2026-01-29 06:02:31 [auto1.it] INFO: Found listing with ID: KM02872
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM02872%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.it] INFO: Scrape type for KM02872: 0
2026-01-29 06:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF06947> (referer: https://www.auto1.com/v1/car-details-view/AF06947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR13454> (referer: https://www.auto1.com/v1/car-details-view/NR13454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814
2026-01-29 06:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a78d3d-65f0-51a0-b4d9-8078aa22613c with scrape type 2
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90a78d3d-65f0-51a0-b4d9-8078aa22613c with scrape type 2
2026-01-29 06:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90a78d3d-65f0-51a0-b4d9-8078aa22613c, identifier: SL26814
2026-01-29 06:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814
2026-01-29 06:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814
2026-01-29 06:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814 to the API
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL26814>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-29T16:16:50Z',
'fuel_type': 'petrol',
'id': '90a78d3d-65f0-51a0-b4d9-8078aa22613c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL26814',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 24821,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2021}
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL26814%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [auto1.it] INFO: Saving data for SL26814: {'auction_closing_time': 1769703410.0, 'created_time': 1769458584.402506, 'last_price_update_time': 1769666552.344539}
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SL26814') HTTP/1.1" 204 0
2026-01-29 06:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 with identifier: AF06947
2026-01-29 06:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86bf1940-cddf-5529-9fba-a2caf5a832b8 with scrape type 2
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86bf1940-cddf-5529-9fba-a2caf5a832b8 with scrape type 2
2026-01-29 06:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 86bf1940-cddf-5529-9fba-a2caf5a832b8, identifier: AF06947
2026-01-29 06:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c0d0a6-d680-505b-8562-8c6b4009a320 with identifier: NR13454
2026-01-29 06:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c0d0a6-d680-505b-8562-8c6b4009a320 with scrape type 2
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c0d0a6-d680-505b-8562-8c6b4009a320 with scrape type 2
2026-01-29 06:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3c0d0a6-d680-505b-8562-8c6b4009a320, identifier: NR13454
2026-01-29 06:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 with identifier: AF06947
2026-01-29 06:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 with identifier: AF06947
2026-01-29 06:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170825 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170825
2026-01-29 06:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 spider: auto1.it
2026-01-29 06:02:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 86bf1940-cddf-5529-9fba-a2caf5a832b8 due to rule: high_mileage_for_country.json, error: 170825 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170825
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 69,
'expiration_date': '2026-01-29T16:32:26Z',
'fuel_type': 'gas',
'id': '86bf1940-cddf-5529-9fba-a2caf5a832b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF06947',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 170825,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 LPG Elefantino Blu',
'transmission': 'manual',
'trim': 'Elefantino Blu',
'year': 2019}
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF06947%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [auto1.it] INFO: Saving data for AF06947: {'auction_closing_time': 1769704346.0, 'created_time': 1768593637.573008, 'last_price_update_time': 1769666552.961443}
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF06947') HTTP/1.1" 204 0
2026-01-29 06:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3c0d0a6-d680-505b-8562-8c6b4009a320 with identifier: NR13454
2026-01-29 06:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3c0d0a6-d680-505b-8562-8c6b4009a320 with identifier: NR13454
2026-01-29 06:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151102 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151102
2026-01-29 06:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f3c0d0a6-d680-505b-8562-8c6b4009a320 spider: auto1.it
2026-01-29 06:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f3c0d0a6-d680-505b-8562-8c6b4009a320 due to rule: high_mileage_for_country.json, error: 151102 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151102
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-01-29T16:58:35Z',
'fuel_type': 'diesel',
'id': 'f3c0d0a6-d680-505b-8562-8c6b4009a320',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR13454',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Kia',
'model': 'Sportage',
'odometer': 151102,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi GT Line 4WD',
'transmission': 'automatic',
'trim': 'GT Line 4WD',
'year': 2019}
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR13454%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.it] INFO: Saving data for NR13454: {'auction_closing_time': 1769705915.0, 'created_time': 1769025655.738013, 'last_price_update_time': 1769666553.226023}
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR13454') HTTP/1.1" 204 0
2026-01-29 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:33 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:33 [auto1.it] INFO: Found listing with ID: DL09487
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL09487%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.it] INFO: Scrape type for DL09487: 0
2026-01-29 06:02:33 [auto1.it] INFO: Found listing with ID: YF03043
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF03043%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.it] INFO: Scrape type for YF03043: 0
2026-01-29 06:02:33 [auto1.it] INFO: Found listing with ID: FC65085
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC65085%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.it] INFO: Scrape type for FC65085: 0
2026-01-29 06:02:33 [auto1.it] INFO: Found listing with ID: EF46876
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF46876%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.it] INFO: Scrape type for EF46876: 0
2026-01-29 06:02:33 [auto1.it] INFO: Found listing with ID: BS31038
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS31038%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.it] INFO: Scrape type for BS31038: 0
2026-01-29 06:02:33 [auto1.it] INFO: Found listing with ID: FP59077
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP59077%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for FP59077: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: XV25208
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25208%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for XV25208: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: ZZ39223
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ39223%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for ZZ39223: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: VH73112
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH73112%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for VH73112: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: ML31196
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML31196%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for ML31196: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: SB13925
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB13925%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for SB13925: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: HV34244
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV34244%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for HV34244: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: ME44881
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44881%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for ME44881: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: BN63900
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63900%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for BN63900: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: SU23914
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU23914%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for SU23914: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: SA98616
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA98616%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for SA98616: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: WL72741
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL72741%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for WL72741: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: XP38725
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38725%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for XP38725: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: BK51963
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK51963%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for BK51963: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: KY70746
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY70746%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for KY70746: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: RU07739
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU07739%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for RU07739: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: BR27248
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR27248%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for BR27248: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: RL30055
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL30055%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for RL30055: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: UZ57933
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ57933%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for UZ57933: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: NZ23957
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ23957%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for NZ23957: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: MW21403
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW21403%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for MW21403: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: YM94819
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM94819%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for YM94819: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: ZT06764
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT06764%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for ZT06764: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: KT18742
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT18742%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for KT18742: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: ZS31369
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS31369%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for ZS31369: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: GA26401
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA26401%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for GA26401: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: VV63858
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63858%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for VV63858: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: NF45221
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF45221%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for NF45221: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: WV62374
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV62374%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for WV62374: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: RF65516
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF65516%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for RF65516: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: KG16431
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG16431%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for KG16431: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: ZS61961
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS61961%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for ZS61961: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: VN78624
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN78624%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for VN78624: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: VE93563
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE93563%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for VE93563: 0
2026-01-29 06:02:34 [auto1.it] INFO: Found listing with ID: ET31750
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET31750%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.it] INFO: Scrape type for ET31750: 0
2026-01-29 06:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:35 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: CZ85123
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ85123%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for CZ85123: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: GV88147
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV88147%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for GV88147: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: VF71012
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF71012%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for VF71012: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: UR17754
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17754%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for UR17754: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: GX99899
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX99899%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for GX99899: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: PX44496
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX44496%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for PX44496: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: DP52947
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP52947%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for DP52947: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: NS14568
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS14568%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for NS14568: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: WA30602
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA30602%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for WA30602: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: RG29856
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG29856%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for RG29856: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: JH70368
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH70368%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for JH70368: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: YY00281
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY00281%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for YY00281: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: NV22132
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV22132%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for NV22132: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: LB37983
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB37983%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for LB37983: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: KX23576
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX23576%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.it] INFO: Scrape type for KX23576: 0
2026-01-29 06:02:35 [auto1.it] INFO: Found listing with ID: WG22278
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for WG22278: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: KP25474
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP25474%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for KP25474: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: WT70784
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT70784%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for WT70784: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: XM98126
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for XM98126: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: GV70344
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV70344%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for GV70344: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: WP79549
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP79549%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for WP79549: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: NX34632
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX34632%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for NX34632: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: LV69875
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV69875%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for LV69875: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: PE10297
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE10297%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for PE10297: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: TU81293
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU81293%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for TU81293: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: AK19049
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK19049%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for AK19049: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: VK07610
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for VK07610: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: AW83792
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW83792%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for AW83792: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: SC19366
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC19366%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for SC19366: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: TH81920
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH81920%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for TH81920: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: UW96841
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96841%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for UW96841: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: MP68527
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP68527%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for MP68527: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: RE03903
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE03903%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for RE03903: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: DZ55749
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ55749%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for DZ55749: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: FR07363
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR07363%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for FR07363: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: YU94462
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for YU94462: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: VP15604
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP15604%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for VP15604: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: UV42227
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV42227%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for UV42227: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: CK01527
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK01527%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for CK01527: 0
2026-01-29 06:02:36 [auto1.it] INFO: Found listing with ID: YS60698
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.it] INFO: Scrape type for YS60698: 0
2026-01-29 06:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY72233> (referer: https://www.auto1.com/v1/car-details-view/LY72233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233
2026-01-29 06:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with scrape type 2
2026-01-29 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with scrape type 2
2026-01-29 06:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13f1f70a-0708-51bb-b5b3-c9697335b6d6, identifier: LY72233
2026-01-29 06:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233
2026-01-29 06:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233
2026-01-29 06:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233 to the API
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY72233>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 220,
'expiration_date': '2026-01-29T16:41:19Z',
'fuel_type': 'diesel',
'id': '13f1f70a-0708-51bb-b5b3-c9697335b6d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY72233',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 95075,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY72233%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.it] INFO: Saving data for LY72233: {'auction_closing_time': 1769704879.0, 'created_time': 1769457723.518248, 'last_price_update_time': 1769666557.379717}
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY72233') HTTP/1.1" 204 0
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: UU45503
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU45503%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for UU45503: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: MA63889
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA63889%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for MA63889: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: PA09787
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA09787%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for PA09787: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: EM48651
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM48651%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for EM48651: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: US18527
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US18527%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for US18527: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: LG07242
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for LG07242: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: UV47695
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for UV47695: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: MX11198
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for MX11198: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: YR64297
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR64297%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for YR64297: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: NC16771
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC16771%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for NC16771: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: KF48878
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF48878%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for KF48878: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: ES44570
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES44570%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for ES44570: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: LN71462
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN71462%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for LN71462: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: MM11522
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM11522%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for MM11522: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: KC58138
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC58138%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for KC58138: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: FZ17961
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ17961%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for FZ17961: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: KG20319
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG20319%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for KG20319: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: YL40875
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL40875%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for YL40875: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: JF20294
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF20294%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for JF20294: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: XR31937
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR31937%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for XR31937: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: MR06591
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR06591%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for MR06591: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: UZ25178
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ25178%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for UZ25178: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: WY20430
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY20430%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for WY20430: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: RT85289
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT85289%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for RT85289: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: HJ72806
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ72806%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for HJ72806: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: WL71449
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL71449%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for WL71449: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: MB91559
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for MB91559: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: VU61741
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU61741%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for VU61741: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: LB74870
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB74870%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for LB74870: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: WC27393
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC27393%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for WC27393: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: EA80460
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA80460%27 HTTP/1.1" 200 None
2026-01-29 06:02:38 [auto1.it] INFO: Scrape type for EA80460: 0
2026-01-29 06:02:38 [auto1.it] INFO: Found listing with ID: ZR94610
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR94610%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for ZR94610: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: HL82578
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL82578%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for HL82578: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: DC36763
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC36763%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for DC36763: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: LR66968
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66968%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for LR66968: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: CB23984
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB23984%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for CB23984: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: LA37582
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA37582%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for LA37582: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: UH74677
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH74677%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for UH74677: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: XZ42851
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ42851%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for XZ42851: 0
2026-01-29 06:02:39 [auto1.it] INFO: Found listing with ID: TJ69567
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ69567%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.it] INFO: Scrape type for TJ69567: 0
2026-01-29 06:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:40 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: LB26900
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB26900%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for LB26900: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: AJ95736
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ95736%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for AJ95736: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: DT16990
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT16990%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for DT16990: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: BE13421
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE13421%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for BE13421: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: JU28816
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU28816%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for JU28816: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: AS87469
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS87469%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for AS87469: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: YT86489
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT86489%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for YT86489: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: LY86301
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY86301%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for LY86301: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: ME44035
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44035%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for ME44035: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: NE66733
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE66733%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for NE66733: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: GC47799
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC47799%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for GC47799: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: DU90270
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU90270%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for DU90270: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: AX41377
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX41377%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for AX41377: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: XY86470
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY86470%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for XY86470: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: NM21779
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM21779%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for NM21779: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: GZ41788
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ41788%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for GZ41788: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: MV90862
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV90862%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for MV90862: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: NE87836
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE87836%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for NE87836: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: ZC79626
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC79626%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for ZC79626: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: FZ01264
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ01264%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for FZ01264: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: FC06007
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC06007%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for FC06007: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: FD10963
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD10963%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for FD10963: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: AE78786
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE78786%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for AE78786: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: ZU18673
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU18673%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for ZU18673: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: EE21788
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE21788%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for EE21788: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: LA82153
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA82153%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for LA82153: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: LM91888
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM91888%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for LM91888: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: EE55407
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE55407%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for EE55407: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: JN06043
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN06043%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for JN06043: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: MP41333
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP41333%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for MP41333: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: WK96429
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK96429%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for WK96429: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: HL10367
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL10367%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for HL10367: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: VB99603
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB99603%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for VB99603: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: EH66713
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH66713%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for EH66713: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: EK64869
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK64869%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for EK64869: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: FU09112
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU09112%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for FU09112: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: WM91186
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91186%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for WM91186: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: CL71823
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL71823%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for CL71823: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: VJ94912
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ94912%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for VJ94912: 0
2026-01-29 06:02:40 [auto1.it] INFO: Found listing with ID: CK57785
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK57785%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.it] INFO: Scrape type for CK57785: 0
2026-01-29 06:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:41 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:41 [auto1.it] INFO: Found listing with ID: XX41967
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX41967%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.it] INFO: Scrape type for XX41967: 0
2026-01-29 06:02:41 [auto1.it] INFO: Found listing with ID: KW25674
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW25674%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for KW25674: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: EN28009
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN28009%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for EN28009: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: NK45302
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK45302%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for NK45302: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: TP44481
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP44481%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for TP44481: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: ST62683
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST62683%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for ST62683: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: AK82218
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK82218%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for AK82218: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: PR00110
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR00110%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for PR00110: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: VF21484
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF21484%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for VF21484: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: MM70569
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70569%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for MM70569: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: ZC81530
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC81530%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for ZC81530: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: YU89741
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU89741%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for YU89741: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: XS07173
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS07173%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for XS07173: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: CE51434
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE51434%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for CE51434: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: EJ48263
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ48263%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for EJ48263: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: SC57699
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57699%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for SC57699: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: CF92520
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF92520%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for CF92520: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: JR02947
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02947%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for JR02947: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: XV95315
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV95315%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for XV95315: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: FJ50946
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ50946%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for FJ50946: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: LE91264
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE91264%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for LE91264: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: YE57930
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE57930%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for YE57930: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: TP50671
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP50671%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for TP50671: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: UL67147
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL67147%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for UL67147: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: JG96200
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG96200%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for JG96200: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: DK02214
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK02214%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for DK02214: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: LN32386
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN32386%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for LN32386: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: CT54414
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for CT54414: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: NR00583
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR00583%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for NR00583: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: SU22727
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU22727%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for SU22727: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: UB59491
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB59491%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for UB59491: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: CM48697
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM48697%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for CM48697: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: XB13849
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB13849%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for XB13849: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: WP98796
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP98796%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for WP98796: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: ZE02649
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02649%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for ZE02649: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: NA87958
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA87958%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for NA87958: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: VK09157
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK09157%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for VK09157: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: SY78749
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY78749%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for SY78749: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: FL32335
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL32335%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for FL32335: 0
2026-01-29 06:02:42 [auto1.it] INFO: Found listing with ID: KE50808
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE50808%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.it] INFO: Scrape type for KE50808: 0
2026-01-29 06:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:43 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:43 [auto1.it] INFO: Found listing with ID: UZ89898
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ89898%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [auto1.it] INFO: Scrape type for UZ89898: 0
2026-01-29 06:02:43 [auto1.it] INFO: Found listing with ID: CA75041
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA75041%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [auto1.it] INFO: Scrape type for CA75041: 0
2026-01-29 06:02:43 [auto1.it] INFO: Found listing with ID: TZ24707
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [auto1.it] INFO: Scrape type for TZ24707: 0
2026-01-29 06:02:43 [auto1.it] INFO: Found listing with ID: HW40098
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW40098%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [auto1.it] INFO: Scrape type for HW40098: 0
2026-01-29 06:02:43 [auto1.it] INFO: Found listing with ID: EJ94115
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ94115%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [auto1.it] INFO: Scrape type for EJ94115: 0
2026-01-29 06:02:43 [auto1.it] INFO: Found listing with ID: EH94386
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH94386%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [auto1.it] INFO: Scrape type for EH94386: 0
2026-01-29 06:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:44 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:44 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-29 06:02:44 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 126}
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201769234564 HTTP/1.1" 200 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AD49796') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CU48152') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FH98389') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FY85628') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HD87156') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JC86581') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KA24183') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NH01572') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PF37946') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RS86581') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TG34730') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UT98071') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VH07773') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WP02751') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XZ66409') HTTP/1.1" 204 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG58323') HTTP/1.1" 204 0
2026-01-29 06:02:45 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (82 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_74_2026-01-29T06_00_03.jl
2026-01-29 06:02:45 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 546401,
'downloader/request_count': 243,
'downloader/request_method_count/GET': 222,
'downloader/request_method_count/POST': 21,
'downloader/response_bytes': 7425855,
'downloader/response_count': 243,
'downloader/response_status_count/200': 243,
'dupefilter/filtered': 2,
'elapsed_time_seconds': 114.102161,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 1, 29, 6, 2, 44, 905537, tzinfo=datetime.timezone.utc),
'item_dropped_count': 28,
'item_dropped_reasons_count/DropItem': 28,
'item_scraped_count': 82,
'log_count/DEBUG': 2690,
'log_count/INFO': 2469,
'memusage/max': 146685952,
'memusage/startup': 126894080,
'request_depth_max': 22,
'response_received_count': 243,
'scheduler/dequeued': 243,
'scheduler/dequeued/memory': 243,
'scheduler/enqueued': 243,
'scheduler/enqueued/memory': 243,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 243,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.701104060221662,
'scrapy-zyte-api/mean_response_seconds': 2.731117443388535,
'scrapy-zyte-api/processed': 243,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 243,
'scrapy-zyte-api/request_args/experimental.requestCookies': 242,
'scrapy-zyte-api/request_args/experimental.responseCookies': 243,
'scrapy-zyte-api/request_args/httpRequestBody': 21,
'scrapy-zyte-api/request_args/httpRequestMethod': 21,
'scrapy-zyte-api/request_args/httpResponseBody': 243,
'scrapy-zyte-api/request_args/httpResponseHeaders': 243,
'scrapy-zyte-api/request_args/sessionContext': 243,
'scrapy-zyte-api/request_args/url': 243,
'scrapy-zyte-api/status_codes/200': 243,
'scrapy-zyte-api/success': 243,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 1, 29, 6, 0, 50, 803376, tzinfo=datetime.timezone.utc)}
2026-01-29 06:02:45 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-29 06:02:45 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6ee6042850>
2026-01-29 06:02:45 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6ee5da9910>