2026-01-27 21:00:11 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-27 21:00:11 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-27 21:00:11 [auto1.it] INFO: Starting spider auto1.it
2026-01-27 21:00:11 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-27 21:00:11 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-27 21:00:11 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-27 21:00:11 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-27 21:00:11 [scrapy.extensions.telnet] INFO: Telnet Password: eefa6627865e7f1a
2026-01-27 21:00:11 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-01-27 21:00:11 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_74_2026-01-27T21_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-01-27 21:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-27 21:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-27 21:00:11 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-27 21:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-27 21:00:11 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-27 21:00:11 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-01-27 21:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 21:00:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 21:00:11 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-27 21:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-27 21:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:12 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-27 21:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-27 21:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-27 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-27 21:00:12 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-27 21:00:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-27 21:00:12 [scrapy.core.engine] INFO: Spider opened
2026-01-27 21:00:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-27 21:00:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-01-27 21:00:12 [scrapy-playwright] INFO: Starting download handler
2026-01-27 21:00:12 [scrapy-playwright] INFO: Starting download handler
2026-01-27 21:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-01-27 21:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-01-27 21:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-01-27 21:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-01-27 21:00:21 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:00:21 [auto1.it] INFO: Found listing with ID: KW61095
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW61095%27 HTTP/1.1" 200 None
2026-01-27 21:00:21 [auto1.it] INFO: Scrape type for KW61095: 0
2026-01-27 21:00:21 [auto1.it] INFO: Found listing with ID: WR69312
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR69312%27 HTTP/1.1" 200 None
2026-01-27 21:00:21 [auto1.it] INFO: Scrape type for WR69312: 0
2026-01-27 21:00:21 [auto1.it] INFO: Found listing with ID: LC12522
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC12522%27 HTTP/1.1" 200 None
2026-01-27 21:00:21 [auto1.it] INFO: Scrape type for LC12522: 0
2026-01-27 21:00:21 [auto1.it] INFO: Found listing with ID: DJ97439
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ97439%27 HTTP/1.1" 200 None
2026-01-27 21:00:21 [auto1.it] INFO: Scrape type for DJ97439: 0
2026-01-27 21:00:21 [auto1.it] INFO: Found listing with ID: KD59831
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD59831%27 HTTP/1.1" 200 None
2026-01-27 21:00:21 [auto1.it] INFO: Scrape type for KD59831: 0
2026-01-27 21:00:21 [auto1.it] INFO: Found listing with ID: YL06979
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL06979%27 HTTP/1.1" 200 None
2026-01-27 21:00:21 [auto1.it] INFO: Scrape type for YL06979: 0
2026-01-27 21:00:21 [auto1.it] INFO: Found listing with ID: AD85366
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85366%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for AD85366: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: WD98953
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for WD98953: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: WA67831
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA67831%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for WA67831: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: ES54295
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES54295%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for ES54295: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: XK25205
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK25205%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for XK25205: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: RV64842
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for RV64842: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: RK87672
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK87672%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for RK87672: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: JE97171
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE97171%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for JE97171: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: JE58021
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE58021%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for JE58021: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: KT64780
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64780%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for KT64780: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: SM84715
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM84715%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for SM84715: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: AY82882
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY82882%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for AY82882: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: RF36302
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF36302%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for RF36302: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: KM31760
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM31760%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for KM31760: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: KL52080
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL52080%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for KL52080: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: RZ08644
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ08644%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for RZ08644: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: ZZ34330
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ34330%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for ZZ34330: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: RG08513
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08513%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for RG08513: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: GK57569
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK57569%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for GK57569: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: ZN33233
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN33233%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for ZN33233: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: SG78459
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG78459%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for SG78459: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: XY55879
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY55879%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for XY55879: 0
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: CW42905
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW42905%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for CW42905: 2
2026-01-27 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: CZ29662
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ29662%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for CZ29662: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: FT66355
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT66355%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for FT66355: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: WM90697
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM90697%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for WM90697: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: GL75859
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL75859%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for GL75859: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: LD57265
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for LD57265: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: PM18246
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for PM18246: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: AZ28034
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for AZ28034: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: JS87755
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for JS87755: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: VB17978
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB17978%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for VB17978: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: UK81379
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81379%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for UK81379: 2
2026-01-27 21:00:22 [auto1.it] INFO: Found listing with ID: WN11922
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN11922%27 HTTP/1.1" 200 None
2026-01-27 21:00:22 [auto1.it] INFO: Scrape type for WN11922: 2
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF36302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY82882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN33233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG08513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL52080/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG78459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM31760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:23 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: KW61095
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW61095%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for KW61095: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: WR69312
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR69312%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for WR69312: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: LC12522
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC12522%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for LC12522: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: DJ97439
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ97439%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for DJ97439: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: KD59831
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD59831%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for KD59831: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: YL06979
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL06979%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for YL06979: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: AD85366
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85366%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for AD85366: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: WD98953
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for WD98953: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: WA67831
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA67831%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for WA67831: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: ES54295
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES54295%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for ES54295: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: XK25205
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK25205%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for XK25205: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: RV64842
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for RV64842: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: RK87672
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK87672%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for RK87672: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: JE97171
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE97171%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for JE97171: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: JE58021
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE58021%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for JE58021: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: KT64780
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64780%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for KT64780: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: SM84715
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM84715%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for SM84715: 0
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: AY82882
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY82882%27 HTTP/1.1" 200 None
2026-01-27 21:00:23 [auto1.it] INFO: Scrape type for AY82882: 2
2026-01-27 21:00:23 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/AY82882/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-01-27 21:00:23 [auto1.it] INFO: Found listing with ID: RF36302
2026-01-27 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF36302%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for RF36302: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: KM31760
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM31760%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for KM31760: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: KL52080
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL52080%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for KL52080: 2
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW42905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: RZ08644
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ08644%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for RZ08644: 0
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: ZZ34330
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ34330%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for ZZ34330: 0
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: RG08513
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08513%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for RG08513: 2
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: GK57569
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK57569%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for GK57569: 0
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: ZN33233
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN33233%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for ZN33233: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: SG78459
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG78459%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for SG78459: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: XY55879
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY55879%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for XY55879: 0
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: CW42905
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW42905%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for CW42905: 2
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM90697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: CZ29662
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ29662%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for CZ29662: 2
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: FT66355
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT66355%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for FT66355: 2
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT66355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: WM90697
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM90697%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for WM90697: 2
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: GL75859
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL75859%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for GL75859: 2
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ29662/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: LD57265
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for LD57265: 2
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: PM18246
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for PM18246: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: AZ28034
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for AZ28034: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: JS87755
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for JS87755: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: VB17978
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB17978%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for VB17978: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: UK81379
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81379%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for UK81379: 2
2026-01-27 21:00:24 [auto1.it] INFO: Found listing with ID: WN11922
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN11922%27 HTTP/1.1" 200 None
2026-01-27 21:00:24 [auto1.it] INFO: Scrape type for WN11922: 2
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD57265/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM18246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL75859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ28034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN11922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK81379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF36302> (referer: https://www.auto1.com/v1/car-details-view/RF36302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac636df-c962-5162-8dd9-4d05dee83661 with identifier: RF36302
2026-01-27 21:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac636df-c962-5162-8dd9-4d05dee83661 with scrape type 2
2026-01-27 21:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac636df-c962-5162-8dd9-4d05dee83661 with scrape type 2
2026-01-27 21:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cac636df-c962-5162-8dd9-4d05dee83661, identifier: RF36302
2026-01-27 21:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cac636df-c962-5162-8dd9-4d05dee83661 with identifier: RF36302
2026-01-27 21:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-01-27 21:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-01-27 21:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cac636df-c962-5162-8dd9-4d05dee83661 with identifier: RF36302
2026-01-27 21:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cac636df-c962-5162-8dd9-4d05dee83661 with identifier: RF36302 to the API
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF36302>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-01-28T16:11:45Z',
'fuel_type': 'petrol',
'id': 'cac636df-c962-5162-8dd9-4d05dee83661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF36302',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 56343,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2021}
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF36302%27 HTTP/1.1" 200 None
2026-01-27 21:00:26 [auto1.it] INFO: Saving data for RF36302: {'auction_closing_time': 1769616705.0, 'created_time': 1769076377.659205, 'last_price_update_time': 1769547626.304248}
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF36302') HTTP/1.1" 204 0
2026-01-27 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY82882> (referer: https://www.auto1.com/v1/car-details-view/AY82882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB17978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG08513> (referer: https://www.auto1.com/v1/car-details-view/RG08513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS87755/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN33233> (referer: https://www.auto1.com/v1/car-details-view/ZN33233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM31760> (referer: https://www.auto1.com/v1/car-details-view/KM31760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792d1a3c-63b0-571e-ac07-1f6f7b94f17e with identifier: AY82882
2026-01-27 21:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792d1a3c-63b0-571e-ac07-1f6f7b94f17e with scrape type 2
2026-01-27 21:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 792d1a3c-63b0-571e-ac07-1f6f7b94f17e with scrape type 2
2026-01-27 21:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 792d1a3c-63b0-571e-ac07-1f6f7b94f17e, identifier: AY82882
2026-01-27 21:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 792d1a3c-63b0-571e-ac07-1f6f7b94f17e with identifier: AY82882
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-01-27 21:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 792d1a3c-63b0-571e-ac07-1f6f7b94f17e with identifier: AY82882
2026-01-27 21:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 792d1a3c-63b0-571e-ac07-1f6f7b94f17e with identifier: AY82882 to the API
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY82882>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2026-01-28T16:23:45Z',
'fuel_type': 'diesel',
'id': '792d1a3c-63b0-571e-ac07-1f6f7b94f17e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY82882',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jaguar',
'model': 'XF',
'odometer': 109966,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XF 25d Prestige AWD',
'transmission': 'automatic',
'trim': 'Prestige AWD',
'year': 2018}
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY82882%27 HTTP/1.1" 200 None
2026-01-27 21:00:27 [auto1.it] INFO: Saving data for AY82882: {'auction_closing_time': 1769617425.0, 'created_time': 1769076130.012326, 'last_price_update_time': 1769547627.100232}
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY82882') HTTP/1.1" 204 0
2026-01-27 21:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f5970f-61c1-5875-b1ed-252cc3b96225 with identifier: RG08513
2026-01-27 21:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f5970f-61c1-5875-b1ed-252cc3b96225 with scrape type 2
2026-01-27 21:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f5970f-61c1-5875-b1ed-252cc3b96225 with scrape type 2
2026-01-27 21:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26f5970f-61c1-5875-b1ed-252cc3b96225, identifier: RG08513
2026-01-27 21:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 597bec49-4dad-5fe2-b747-4481870539d4 with identifier: ZN33233
2026-01-27 21:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 597bec49-4dad-5fe2-b747-4481870539d4 with scrape type 2
2026-01-27 21:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 597bec49-4dad-5fe2-b747-4481870539d4 with scrape type 2
2026-01-27 21:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 597bec49-4dad-5fe2-b747-4481870539d4, identifier: ZN33233
2026-01-27 21:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383f5811-7824-5fc8-8475-859ebbc383da with identifier: KM31760
2026-01-27 21:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383f5811-7824-5fc8-8475-859ebbc383da with scrape type 2
2026-01-27 21:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 383f5811-7824-5fc8-8475-859ebbc383da with scrape type 2
2026-01-27 21:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 383f5811-7824-5fc8-8475-859ebbc383da, identifier: KM31760
2026-01-27 21:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26f5970f-61c1-5875-b1ed-252cc3b96225 with identifier: RG08513
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-01-27 21:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26f5970f-61c1-5875-b1ed-252cc3b96225 with identifier: RG08513
2026-01-27 21:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26f5970f-61c1-5875-b1ed-252cc3b96225 with identifier: RG08513 to the API
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG08513>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-01-28T16:18:39Z',
'fuel_type': 'petrol',
'id': '26f5970f-61c1-5875-b1ed-252cc3b96225',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG08513',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Renault',
'model': 'Captur',
'odometer': 82316,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 0.9 TCe Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2020}
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08513%27 HTTP/1.1" 200 None
2026-01-27 21:00:27 [auto1.it] INFO: Saving data for RG08513: {'auction_closing_time': 1769617119.0, 'created_time': 1769458083.466283, 'last_price_update_time': 1769547627.861163}
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG08513') HTTP/1.1" 204 0
2026-01-27 21:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 597bec49-4dad-5fe2-b747-4481870539d4 with identifier: ZN33233
2026-01-27 21:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 597bec49-4dad-5fe2-b747-4481870539d4 with identifier: ZN33233
2026-01-27 21:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166230 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166230
2026-01-27 21:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 597bec49-4dad-5fe2-b747-4481870539d4 spider: auto1.it
2026-01-27 21:00:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 597bec49-4dad-5fe2-b747-4481870539d4 due to rule: high_mileage_for_country.json, error: 166230 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166230
{'auction_title': '',
'c_o_2_emission_value': 190,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.9L',
'engine_horse_power': 272,
'expiration_date': '2026-01-28T16:02:00Z',
'fuel_type': 'diesel',
'id': '597bec49-4dad-5fe2-b747-4481870539d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN33233',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 166230,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN33233%27 HTTP/1.1" 200 None
2026-01-27 21:00:28 [auto1.it] INFO: Saving data for ZN33233: {'auction_closing_time': 1769616120.0, 'created_time': 1769458107.105215, 'last_price_update_time': 1769547628.078778}
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZN33233') HTTP/1.1" 204 0
2026-01-27 21:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 383f5811-7824-5fc8-8475-859ebbc383da with identifier: KM31760
2026-01-27 21:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 383f5811-7824-5fc8-8475-859ebbc383da with identifier: KM31760
2026-01-27 21:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 383f5811-7824-5fc8-8475-859ebbc383da with identifier: KM31760 to the API
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KM31760>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:06:22Z',
'fuel_type': 'diesel',
'id': '383f5811-7824-5fc8-8475-859ebbc383da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM31760',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 58034,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM31760%27 HTTP/1.1" 200 None
2026-01-27 21:00:28 [auto1.it] INFO: Saving data for KM31760: {'auction_closing_time': 1769616382.0, 'created_time': 1769458109.799733, 'last_price_update_time': 1769547628.385607}
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM31760') HTTP/1.1" 204 0
2026-01-27 21:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW42905> (referer: https://www.auto1.com/v1/car-details-view/CW42905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG78459> (referer: https://www.auto1.com/v1/car-details-view/SG78459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121a77bf-9bac-5566-bb97-f534ea4a6ea8 with identifier: CW42905
2026-01-27 21:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121a77bf-9bac-5566-bb97-f534ea4a6ea8 with scrape type 2
2026-01-27 21:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 121a77bf-9bac-5566-bb97-f534ea4a6ea8 with scrape type 2
2026-01-27 21:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 121a77bf-9bac-5566-bb97-f534ea4a6ea8, identifier: CW42905
2026-01-27 21:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 121a77bf-9bac-5566-bb97-f534ea4a6ea8 with identifier: CW42905
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-01-27 21:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 121a77bf-9bac-5566-bb97-f534ea4a6ea8 with identifier: CW42905
2026-01-27 21:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 121a77bf-9bac-5566-bb97-f534ea4a6ea8 with identifier: CW42905 to the API
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW42905>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.9L',
'engine_horse_power': 285,
'expiration_date': '2026-01-28T16:41:24Z',
'fuel_type': 'diesel',
'id': '121a77bf-9bac-5566-bb97-f534ea4a6ea8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW42905',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 148126,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic Premium',
'transmission': 'automatic',
'trim': '4Matic Premium',
'year': 2020}
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW42905%27 HTTP/1.1" 200 None
2026-01-27 21:00:29 [auto1.it] INFO: Saving data for CW42905: {'auction_closing_time': 1769618484.0, 'created_time': 1769458585.402376, 'last_price_update_time': 1769547629.011275}
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW42905') HTTP/1.1" 204 0
2026-01-27 21:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0 with identifier: SG78459
2026-01-27 21:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0 with scrape type 2
2026-01-27 21:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0 with scrape type 2
2026-01-27 21:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0, identifier: SG78459
2026-01-27 21:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0 with identifier: SG78459
2026-01-27 21:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0 with identifier: SG78459
2026-01-27 21:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 1.6 td premium 4x4', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'automatic', 'odometer': 71113, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg78459', 'expiration_date': '2026-01-28t16:38:08z', 'origin_country_code': 'it', 'trim': 'premium 4x4', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 136, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, settimo torinese', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 144, 'id': '1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 71113}
Failed validating None in schema:
False
On instance:
{'age_in_months': 62,
'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6d-temp',
'engine': '1.6l',
'engine_horse_power': 136,
'expiration_date': '2026-01-28t16:38:08z',
'fuel_type': 'diesel',
'id': '1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg78459',
'listing': 'auction',
'location': 'it, settimo torinese',
'make': 'ssangyong',
'make_model': 'ssangyong korando',
'model': 'korando',
'odometer': 71113,
'odometer_in_km': 71113,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-26',
'sanitized_make': 'ssangyong',
'seats_number': 5,
'seller_name': None,
'title': 'ssangyong korando 1.6 td premium 4x4',
'transmission': 'automatic',
'trim': 'premium 4x4',
'year': 2020}
2026-01-27 21:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0 spider: auto1.it
2026-01-27 21:00:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 1.6 td premium 4x4', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'automatic', 'odometer': 71113, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg78459', 'expiration_date': '2026-01-28t16:38:08z', 'origin_country_code': 'it', 'trim': 'premium 4x4', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 136, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, settimo torinese', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 144, 'id': '1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 71113}
Failed validating None in schema:
False
On instance:
{'age_in_months': 62,
'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6d-temp',
'engine': '1.6l',
'engine_horse_power': 136,
'expiration_date': '2026-01-28t16:38:08z',
'fuel_type': 'diesel',
'id': '1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg78459',
'listing': 'auction',
'location': 'it, settimo torinese',
'make': 'ssangyong',
'make_model': 'ssangyong korando',
'model': 'korando',
'odometer': 71113,
'odometer_in_km': 71113,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-26',
'sanitized_make': 'ssangyong',
'seats_number': 5,
'seller_name': None,
'title': 'ssangyong korando 1.6 td premium 4x4',
'transmission': 'automatic',
'trim': 'premium 4x4',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-01-28T16:38:08Z',
'fuel_type': 'diesel',
'id': '1fbc7a7d-b8e1-5dbe-a1e7-f1a366af07d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG78459',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Ssangyong',
'model': 'Korando',
'odometer': 71113,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'Ssangyong Korando 1.6 TD Premium 4x4',
'transmission': 'automatic',
'trim': 'Premium 4x4',
'year': 2020}
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG78459%27 HTTP/1.1" 200 None
2026-01-27 21:00:29 [auto1.it] INFO: Saving data for SG78459: {'auction_closing_time': 1769618288.0, 'created_time': 1769458412.125518, 'last_price_update_time': 1769547629.353881}
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG78459') HTTP/1.1" 204 0
2026-01-27 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL52080> (referer: https://www.auto1.com/v1/car-details-view/KL52080/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ28034> (referer: https://www.auto1.com/v1/car-details-view/AZ28034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT66355> (referer: https://www.auto1.com/v1/car-details-view/FT66355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM90697> (referer: https://www.auto1.com/v1/car-details-view/WM90697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ29662> (referer: https://www.auto1.com/v1/car-details-view/CZ29662/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:29 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:00:29 [auto1.it] INFO: Found listing with ID: UA54373
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2026-01-27 21:00:29 [auto1.it] INFO: Scrape type for UA54373: 2
2026-01-27 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef8d8e8-9b18-5eab-9617-aa975a83d59f with identifier: KL52080
2026-01-27 21:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef8d8e8-9b18-5eab-9617-aa975a83d59f with scrape type 2
2026-01-27 21:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef8d8e8-9b18-5eab-9617-aa975a83d59f with scrape type 2
2026-01-27 21:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eef8d8e8-9b18-5eab-9617-aa975a83d59f, identifier: KL52080
2026-01-27 21:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eef8d8e8-9b18-5eab-9617-aa975a83d59f with identifier: KL52080
2026-01-27 21:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eef8d8e8-9b18-5eab-9617-aa975a83d59f with identifier: KL52080
2026-01-27 21:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eef8d8e8-9b18-5eab-9617-aa975a83d59f with identifier: KL52080 to the API
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL52080>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:43:23Z',
'fuel_type': 'diesel',
'id': 'eef8d8e8-9b18-5eab-9617-aa975a83d59f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL52080',
'listing': 'auction',
'location': 'IT, Trento',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 121664,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2021}
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL52080%27 HTTP/1.1" 200 None
2026-01-27 21:00:29 [auto1.it] INFO: Saving data for KL52080: {'auction_closing_time': 1769618603.0, 'created_time': 1769458400.681951, 'last_price_update_time': 1769547629.940457}
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL52080') HTTP/1.1" 204 0
2026-01-27 21:00:29 [auto1.it] INFO: Found listing with ID: AR75288
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-01-27 21:00:29 [auto1.it] INFO: Scrape type for AR75288: 2
2026-01-27 21:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034
2026-01-27 21:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with scrape type 2
2026-01-27 21:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with scrape type 2
2026-01-27 21:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a, identifier: AZ28034
2026-01-27 21:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b454ad-95a7-506b-936e-fd57c5608380 with identifier: FT66355
2026-01-27 21:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b454ad-95a7-506b-936e-fd57c5608380 with scrape type 2
2026-01-27 21:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97b454ad-95a7-506b-936e-fd57c5608380 with scrape type 2
2026-01-27 21:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97b454ad-95a7-506b-936e-fd57c5608380, identifier: FT66355
2026-01-27 21:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62a85e04-559d-5657-bb79-d920f9473484 with identifier: WM90697
2026-01-27 21:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62a85e04-559d-5657-bb79-d920f9473484 with scrape type 2
2026-01-27 21:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62a85e04-559d-5657-bb79-d920f9473484 with scrape type 2
2026-01-27 21:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62a85e04-559d-5657-bb79-d920f9473484, identifier: WM90697
2026-01-27 21:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ff64b0-0a69-5b1c-abe3-924abab0b235 with identifier: CZ29662
2026-01-27 21:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ff64b0-0a69-5b1c-abe3-924abab0b235 with scrape type 2
2026-01-27 21:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52ff64b0-0a69-5b1c-abe3-924abab0b235 with scrape type 2
2026-01-27 21:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52ff64b0-0a69-5b1c-abe3-924abab0b235, identifier: CZ29662
2026-01-27 21:00:30 [auto1.it] INFO: Found listing with ID: AM19633
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM19633%27 HTTP/1.1" 200 None
2026-01-27 21:00:30 [auto1.it] INFO: Scrape type for AM19633: 2
2026-01-27 21:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-01-27 21:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-01-27 21:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034
2026-01-27 21:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c4f45f5-32d4-5eea-bb1f-99d9b721154a with identifier: AZ28034 to the API
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AZ28034>
{'auction_title': '',
'c_o_2_emission_value': 79,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 381,
'expiration_date': '2026-01-28T16:59:11Z',
'fuel_type': 'hybrid',
'id': '8c4f45f5-32d4-5eea-bb1f-99d9b721154a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ28034',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 127116,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid 80th Anniversary',
'transmission': 'automatic',
'trim': '80th Anniversary',
'year': 2021}
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-27 21:00:31 [auto1.it] INFO: Saving data for AZ28034: {'auction_closing_time': 1769619551.0, 'created_time': 1769457775.822425, 'last_price_update_time': 1769547631.437447}
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AZ28034') HTTP/1.1" 204 0
2026-01-27 21:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97b454ad-95a7-506b-936e-fd57c5608380 with identifier: FT66355
2026-01-27 21:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97b454ad-95a7-506b-936e-fd57c5608380 with identifier: FT66355
2026-01-27 21:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154699 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154699
2026-01-27 21:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 97b454ad-95a7-506b-936e-fd57c5608380 spider: auto1.it
2026-01-27 21:00:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 97b454ad-95a7-506b-936e-fd57c5608380 due to rule: high_mileage_for_country.json, error: 154699 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154699
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-01-28T16:51:49Z',
'fuel_type': 'diesel',
'id': '97b454ad-95a7-506b-936e-fd57c5608380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT66355',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'A6',
'odometer': 154699,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-14',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 35 TDI Mild-Hybrid sport',
'transmission': 'automatic',
'trim': 'sport',
'year': 2020}
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT66355%27 HTTP/1.1" 200 None
2026-01-27 21:00:31 [auto1.it] INFO: Saving data for FT66355: {'auction_closing_time': 1769619109.0, 'created_time': 1768939596.049252, 'last_price_update_time': 1769547631.689189}
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT66355') HTTP/1.1" 204 0
2026-01-27 21:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62a85e04-559d-5657-bb79-d920f9473484 with identifier: WM90697
2026-01-27 21:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62a85e04-559d-5657-bb79-d920f9473484 with identifier: WM90697
2026-01-27 21:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166215 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166215
2026-01-27 21:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 62a85e04-559d-5657-bb79-d920f9473484 spider: auto1.it
2026-01-27 21:00:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 62a85e04-559d-5657-bb79-d920f9473484 due to rule: high_mileage_for_country.json, error: 166215 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166215
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:02:51Z',
'fuel_type': 'diesel',
'id': '62a85e04-559d-5657-bb79-d920f9473484',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM90697',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 166215,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.6 TDI Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2019}
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM90697%27 HTTP/1.1" 200 None
2026-01-27 21:00:31 [auto1.it] INFO: Saving data for WM90697: {'auction_closing_time': 1769616171.0, 'created_time': 1769025780.271199, 'last_price_update_time': 1769547631.988137}
2026-01-27 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM90697') HTTP/1.1" 204 0
2026-01-27 21:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52ff64b0-0a69-5b1c-abe3-924abab0b235 with identifier: CZ29662
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-01-27 21:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52ff64b0-0a69-5b1c-abe3-924abab0b235 with identifier: CZ29662
2026-01-27 21:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52ff64b0-0a69-5b1c-abe3-924abab0b235 with identifier: CZ29662 to the API
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ29662>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:22:35Z',
'fuel_type': 'petrol',
'id': '52ff64b0-0a69-5b1c-abe3-924abab0b235',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ29662',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 116415,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.0 TGDi Limited 4x2',
'transmission': 'manual',
'trim': 'Limited 4x2',
'year': 2018}
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ29662%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Saving data for CZ29662: {'auction_closing_time': 1769617355.0, 'created_time': 1769458248.598583, 'last_price_update_time': 1769547632.426053}
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ29662') HTTP/1.1" 204 0
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: LZ66498
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ66498%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for LZ66498: 2
2026-01-27 21:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN11922> (referer: https://www.auto1.com/v1/car-details-view/WN11922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL75859> (referer: https://www.auto1.com/v1/car-details-view/GL75859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: WN49537
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN49537%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for WN49537: 2
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: PX31036
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX31036%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for PX31036: 0
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: UP48367
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for UP48367: 2
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: PM87024
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM87024%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for PM87024: 2
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: KZ89733
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ89733%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for KZ89733: 2
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: NV95469
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV95469%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for NV95469: 2
2026-01-27 21:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb069a0e-b69f-533f-bdcf-6978e84f1825 with identifier: WN11922
2026-01-27 21:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb069a0e-b69f-533f-bdcf-6978e84f1825 with scrape type 2
2026-01-27 21:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb069a0e-b69f-533f-bdcf-6978e84f1825 with scrape type 2
2026-01-27 21:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb069a0e-b69f-533f-bdcf-6978e84f1825, identifier: WN11922
2026-01-27 21:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8f99e6-e9b0-5a1d-845a-a46241f7a652 with identifier: GL75859
2026-01-27 21:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8f99e6-e9b0-5a1d-845a-a46241f7a652 with scrape type 2
2026-01-27 21:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a8f99e6-e9b0-5a1d-845a-a46241f7a652 with scrape type 2
2026-01-27 21:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a8f99e6-e9b0-5a1d-845a-a46241f7a652, identifier: GL75859
2026-01-27 21:00:32 [auto1.it] INFO: Found listing with ID: RL99937
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL99937%27 HTTP/1.1" 200 None
2026-01-27 21:00:32 [auto1.it] INFO: Scrape type for RL99937: 2
2026-01-27 21:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb069a0e-b69f-533f-bdcf-6978e84f1825 with identifier: WN11922
2026-01-27 21:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb069a0e-b69f-533f-bdcf-6978e84f1825 with identifier: WN11922
2026-01-27 21:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb069a0e-b69f-533f-bdcf-6978e84f1825 with identifier: WN11922 to the API
2026-01-27 21:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WN11922>
{'auction_title': '',
'c_o_2_emission_value': 29,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 320,
'expiration_date': '2026-01-28T16:26:59Z',
'fuel_type': 'hybrid',
'id': 'fb069a0e-b69f-533f-bdcf-6978e84f1825',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN11922',
'listing': 'auction',
'location': 'Novara',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 84976,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN11922%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Saving data for WN11922: {'auction_closing_time': 1769617619.0, 'created_time': 1769458206.636153, 'last_price_update_time': 1769547633.206478}
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN11922') HTTP/1.1" 204 0
2026-01-27 21:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a8f99e6-e9b0-5a1d-845a-a46241f7a652 with identifier: GL75859
2026-01-27 21:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a8f99e6-e9b0-5a1d-845a-a46241f7a652 with identifier: GL75859
2026-01-27 21:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a8f99e6-e9b0-5a1d-845a-a46241f7a652 with identifier: GL75859 to the API
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GL75859>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:46:01Z',
'fuel_type': 'diesel',
'id': '3a8f99e6-e9b0-5a1d-845a-a46241f7a652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL75859',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'BMW',
'model': 'X3',
'odometer': 94236,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL75859%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Saving data for GL75859: {'auction_closing_time': 1769618761.0, 'created_time': 1769458392.487889, 'last_price_update_time': 1769547633.601792}
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GL75859') HTTP/1.1" 204 0
2026-01-27 21:00:33 [auto1.it] INFO: Found listing with ID: DN61580
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN61580%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Scrape type for DN61580: 2
2026-01-27 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK81379> (referer: https://www.auto1.com/v1/car-details-view/UK81379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS87755> (referer: https://www.auto1.com/v1/car-details-view/JS87755/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB17978> (referer: https://www.auto1.com/v1/car-details-view/VB17978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM18246> (referer: https://www.auto1.com/v1/car-details-view/PM18246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD57265> (referer: https://www.auto1.com/v1/car-details-view/LD57265/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:33 [auto1.it] INFO: Found listing with ID: XD70855
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Scrape type for XD70855: 2
2026-01-27 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:33 [auto1.it] INFO: Found listing with ID: VG01482
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG01482%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Scrape type for VG01482: 0
2026-01-27 21:00:33 [auto1.it] INFO: Found listing with ID: NA73854
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA73854%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Scrape type for NA73854: 2
2026-01-27 21:00:33 [auto1.it] INFO: Found listing with ID: LA77465
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA77465%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Scrape type for LA77465: 2
2026-01-27 21:00:33 [auto1.it] INFO: Found listing with ID: SV83223
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV83223%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Scrape type for SV83223: 2
2026-01-27 21:00:33 [auto1.it] INFO: Found listing with ID: XU61631
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU61631%27 HTTP/1.1" 200 None
2026-01-27 21:00:33 [auto1.it] INFO: Scrape type for XU61631: 2
2026-01-27 21:00:33 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379
2026-01-27 21:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4389e757-555a-5e77-a5b7-c9be14a150d3 with scrape type 2
2026-01-27 21:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4389e757-555a-5e77-a5b7-c9be14a150d3 with scrape type 2
2026-01-27 21:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4389e757-555a-5e77-a5b7-c9be14a150d3, identifier: UK81379
2026-01-27 21:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755
2026-01-27 21:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43af84b-bc0d-5292-aff5-a40b60e24ae9 with scrape type 2
2026-01-27 21:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d43af84b-bc0d-5292-aff5-a40b60e24ae9 with scrape type 2
2026-01-27 21:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d43af84b-bc0d-5292-aff5-a40b60e24ae9, identifier: JS87755
2026-01-27 21:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77952df7-3ba0-5c08-90be-f540ad559fd6 with identifier: VB17978
2026-01-27 21:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77952df7-3ba0-5c08-90be-f540ad559fd6 with scrape type 2
2026-01-27 21:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77952df7-3ba0-5c08-90be-f540ad559fd6 with scrape type 2
2026-01-27 21:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77952df7-3ba0-5c08-90be-f540ad559fd6, identifier: VB17978
2026-01-27 21:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e59705c-12fc-5f5b-91b3-5d349e9aa588 with identifier: PM18246
2026-01-27 21:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e59705c-12fc-5f5b-91b3-5d349e9aa588 with scrape type 2
2026-01-27 21:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e59705c-12fc-5f5b-91b3-5d349e9aa588 with scrape type 2
2026-01-27 21:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e59705c-12fc-5f5b-91b3-5d349e9aa588, identifier: PM18246
2026-01-27 21:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-01-27 21:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with scrape type 2
2026-01-27 21:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with scrape type 2
2026-01-27 21:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00bfeec1-6ca8-517a-8a76-c405df2aeb12, identifier: LD57265
2026-01-27 21:00:34 [auto1.it] INFO: Found listing with ID: SJ77848
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ77848%27 HTTP/1.1" 200 None
2026-01-27 21:00:34 [auto1.it] INFO: Scrape type for SJ77848: 2
2026-01-27 21:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379
2026-01-27 21:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379
2026-01-27 21:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379 to the API
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK81379>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:09:46Z',
'fuel_type': 'diesel',
'id': '4389e757-555a-5e77-a5b7-c9be14a150d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK81379',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'Q2',
'odometer': 74550,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-01',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2022}
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81379%27 HTTP/1.1" 200 None
2026-01-27 21:00:34 [auto1.it] INFO: Saving data for UK81379: {'auction_closing_time': 1769616586.0, 'created_time': 1769457894.606746, 'last_price_update_time': 1769547634.604192}
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK81379') HTTP/1.1" 204 0
2026-01-27 21:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755
2026-01-27 21:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755
2026-01-27 21:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755 to the API
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS87755>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:32:48Z',
'fuel_type': 'petrol',
'id': 'd43af84b-bc0d-5292-aff5-a40b60e24ae9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS87755',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 5137,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-29',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2026-01-27 21:00:34 [auto1.it] INFO: Saving data for JS87755: {'auction_closing_time': 1769617968.0, 'created_time': 1769458261.469402, 'last_price_update_time': 1769547634.971197}
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS87755') HTTP/1.1" 204 0
2026-01-27 21:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77952df7-3ba0-5c08-90be-f540ad559fd6 with identifier: VB17978
2026-01-27 21:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77952df7-3ba0-5c08-90be-f540ad559fd6 with identifier: VB17978
2026-01-27 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-27 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 77952df7-3ba0-5c08-90be-f540ad559fd6 spider: auto1.it
2026-01-27 21:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 77952df7-3ba0-5c08-90be-f540ad559fd6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-01-28T16:58:38Z',
'fuel_type': 'petrol',
'id': '77952df7-3ba0-5c08-90be-f540ad559fd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB17978',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Fiat',
'model': 'Panda',
'odometer': 16039,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-04-29',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB17978%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Saving data for VB17978: {'auction_closing_time': 1769619518.0, 'created_time': 1769458300.545123, 'last_price_update_time': 1769547635.18207}
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB17978') HTTP/1.1" 204 0
2026-01-27 21:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e59705c-12fc-5f5b-91b3-5d349e9aa588 with identifier: PM18246
2026-01-27 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e59705c-12fc-5f5b-91b3-5d349e9aa588 with identifier: PM18246
2026-01-27 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158835 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158835
2026-01-27 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6e59705c-12fc-5f5b-91b3-5d349e9aa588 spider: auto1.it
2026-01-27 21:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 6e59705c-12fc-5f5b-91b3-5d349e9aa588 due to rule: high_mileage_for_country.json, error: 158835 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158835
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-01-28T16:06:26Z',
'fuel_type': 'petrol',
'id': '6e59705c-12fc-5f5b-91b3-5d349e9aa588',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM18246',
'listing': 'auction',
'location': "IT, Cassano D'Adda",
'make': 'Ford',
'model': 'Fiesta',
'odometer': 158835,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-02',
'seats_number': 2,
'seller_name': None,
'title': 'Ford Fiesta 1.1 Ti-VCT Connect Business',
'transmission': 'manual',
'trim': 'Connect Business',
'year': 2021}
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Saving data for PM18246: {'auction_closing_time': 1769616386.0, 'created_time': 1769458241.375974, 'last_price_update_time': 1769547635.400285}
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM18246') HTTP/1.1" 204 0
2026-01-27 21:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-01-27 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-01-27 21:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265 to the API
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LD57265>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:47:28Z',
'fuel_type': 'diesel',
'id': '00bfeec1-6ca8-517a-8a76-c405df2aeb12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD57265',
'listing': 'auction',
'location': 'Ferrara',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 143043,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-25',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2021}
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Saving data for LD57265: {'auction_closing_time': 1769618848.0, 'created_time': 1769458240.256474, 'last_price_update_time': 1769547635.690551}
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD57265') HTTP/1.1" 204 0
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: RJ17410
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ17410%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for RJ17410: 0
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: EH01069
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH01069%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for EH01069: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: PP03591
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP03591%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for PP03591: 2
2026-01-27 21:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR75288/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: BF67818
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF67818%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for BF67818: 0
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: TW52947
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW52947%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for TW52947: 2
2026-01-27 21:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA54373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: AD03373
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD03373%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for AD03373: 2
2026-01-27 21:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: AB48046
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB48046%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for AB48046: 0
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: TZ58430
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ58430%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for TZ58430: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: HL10790
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL10790%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for HL10790: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: ET25388
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET25388%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for ET25388: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: RE39757
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE39757%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for RE39757: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: CA86340
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA86340%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for CA86340: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: JE15416
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE15416%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for JE15416: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: RA25408
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for RA25408: 2
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: DR27606
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27606%27 HTTP/1.1" 200 None
2026-01-27 21:00:35 [auto1.it] INFO: Scrape type for DR27606: 0
2026-01-27 21:00:35 [auto1.it] INFO: Found listing with ID: HG00560
2026-01-27 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG00560%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for HG00560: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: FJ70375
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ70375%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for FJ70375: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: UW51000
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW51000%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for UW51000: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: XL96089
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL96089%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for XL96089: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: MJ25733
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ25733%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for MJ25733: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: CD79561
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for CD79561: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: GB07177
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB07177%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for GB07177: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: UD04779
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD04779%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for UD04779: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: ZH94577
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH94577%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for ZH94577: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: JF86127
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF86127%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for JF86127: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: PY58438
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58438%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for PY58438: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: AB69922
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB69922%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for AB69922: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: SA14843
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA14843%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for SA14843: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: HC32462
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC32462%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for HC32462: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: GT57275
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT57275%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for GT57275: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: KF29080
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF29080%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for KF29080: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: LX93740
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93740%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for LX93740: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: ZH19679
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH19679%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for ZH19679: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: KE15341
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE15341%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for KE15341: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: ML77651
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML77651%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for ML77651: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: JU84711
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU84711%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for JU84711: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: KJ26338
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ26338%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for KJ26338: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: AV65430
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV65430%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for AV65430: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: VX57243
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX57243%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for VX57243: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: DA44025
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44025%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for DA44025: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: HE10991
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE10991%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for HE10991: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: PC33365
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC33365%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for PC33365: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: GC49828
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC49828%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for GC49828: 2
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM87024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: VH61995
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH61995%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for VH61995: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: SK38544
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK38544%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for SK38544: 2
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: CB94956
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB94956%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for CB94956: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: WK84125
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK84125%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for WK84125: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: VB04697
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04697%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for VB04697: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: ZX21945
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX21945%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for ZX21945: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: RR19391
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR19391%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for RR19391: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: CS53941
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS53941%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for CS53941: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: GZ43068
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ43068%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for GZ43068: 2
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: FX49357
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX49357%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for FX49357: 2
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN49537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: KS32404
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS32404%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for KS32404: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: FK29975
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK29975%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for FK29975: 2
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: JN76838
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN76838%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for JN76838: 2
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM19633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: VT38292
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT38292%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for VT38292: 2
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP48367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: RB81856
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB81856%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for RB81856: 2
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: DJ83260
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ83260%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for DJ83260: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: RW56209
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW56209%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for RW56209: 0
2026-01-27 21:00:36 [auto1.it] INFO: Found listing with ID: FC83835
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC83835%27 HTTP/1.1" 200 None
2026-01-27 21:00:36 [auto1.it] INFO: Scrape type for FC83835: 0
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV95469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL99937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ66498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ89733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA77465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD70855/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN61580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA73854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV83223/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:37 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:00:37 [auto1.it] INFO: Found listing with ID: VJ15717
2026-01-27 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ15717%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for VJ15717: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: KW71256
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW71256%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for KW71256: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: CL92988
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL92988%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for CL92988: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: EF33407
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF33407%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for EF33407: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: BD40988
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD40988%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for BD40988: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: NF51505
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF51505%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for NF51505: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: XY44417
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY44417%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for XY44417: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: YH86928
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH86928%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for YH86928: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: WH29835
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH29835%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for WH29835: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: NN32149
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN32149%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for NN32149: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: VH97733
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH97733%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for VH97733: 2
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH01069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: TL58155
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL58155%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for TL58155: 2
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: YE37664
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE37664%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for YE37664: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: SS94947
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for SS94947: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: SC16084
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC16084%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for SC16084: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: CA13828
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA13828%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for CA13828: 2
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP03591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: HA56454
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA56454%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for HA56454: 2
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: ZR47536
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR47536%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for ZR47536: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: ZN59549
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN59549%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for ZN59549: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: JB16997
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB16997%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for JB16997: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: FU18669
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU18669%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for FU18669: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: DA91703
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA91703%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for DA91703: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: SB20175
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB20175%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for SB20175: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: DZ26704
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ26704%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for DZ26704: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: LZ51611
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ51611%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for LZ51611: 2
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC49828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: UL25385
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL25385%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for UL25385: 2
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: XR21079
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR21079%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for XR21079: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: SX45481
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX45481%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for SX45481: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: MB93346
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB93346%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for MB93346: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: UW70389
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW70389%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for UW70389: 2
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN76838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT38292/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: FD40638
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD40638%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for FD40638: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: UB21485
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB21485%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for UB21485: 2
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: JY28433
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY28433%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for JY28433: 2
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB81856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX49357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: WB03743
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB03743%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for WB03743: 0
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: ZW29655
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW29655%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for ZW29655: 2
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: MG41952
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG41952%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for MG41952: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: EA43401
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA43401%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for EA43401: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: LZ25760
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for LZ25760: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: EE79301
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE79301%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for EE79301: 2
2026-01-27 21:00:38 [auto1.it] INFO: Found listing with ID: DT68594
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT68594%27 HTTP/1.1" 200 None
2026-01-27 21:00:38 [auto1.it] INFO: Scrape type for DT68594: 2
2026-01-27 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP48367> (referer: https://www.auto1.com/v1/car-details-view/UP48367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-01-27 21:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2e3a76-7810-5d6e-a16f-189a3ba21870 with scrape type 2
2026-01-27 21:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2e3a76-7810-5d6e-a16f-189a3ba21870 with scrape type 2
2026-01-27 21:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: da2e3a76-7810-5d6e-a16f-189a3ba21870, identifier: UP48367
2026-01-27 21:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-01-27 21:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-01-27 21:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162798 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162798
2026-01-27 21:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: da2e3a76-7810-5d6e-a16f-189a3ba21870 spider: auto1.it
2026-01-27 21:00:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: da2e3a76-7810-5d6e-a16f-189a3ba21870 due to rule: high_mileage_for_country.json, error: 162798 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162798
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:58:26Z',
'fuel_type': 'diesel',
'id': 'da2e3a76-7810-5d6e-a16f-189a3ba21870',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP48367',
'listing': 'auction',
'location': 'IT, Giugliano in Campania',
'make': 'Fiat',
'model': '500X',
'odometer': 162798,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Pop Star',
'transmission': 'automatic',
'trim': 'Pop Star',
'year': 2018}
2026-01-27 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-01-27 21:00:39 [auto1.it] INFO: Saving data for UP48367: {'auction_closing_time': 1769619506.0, 'created_time': 1769457754.120622, 'last_price_update_time': 1769547639.678362}
2026-01-27 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UP48367') HTTP/1.1" 204 0
2026-01-27 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM19633> (referer: https://www.auto1.com/v1/car-details-view/AM19633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV95469> (referer: https://www.auto1.com/v1/car-details-view/NV95469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ66498> (referer: https://www.auto1.com/v1/car-details-view/LZ66498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL99937> (referer: https://www.auto1.com/v1/car-details-view/RL99937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA73854> (referer: https://www.auto1.com/v1/car-details-view/NA73854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ89733> (referer: https://www.auto1.com/v1/car-details-view/KZ89733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313d8250-41d1-5f33-9d8b-fe99f1264e2e with identifier: AM19633
2026-01-27 21:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313d8250-41d1-5f33-9d8b-fe99f1264e2e with scrape type 2
2026-01-27 21:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 313d8250-41d1-5f33-9d8b-fe99f1264e2e with scrape type 2
2026-01-27 21:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 313d8250-41d1-5f33-9d8b-fe99f1264e2e, identifier: AM19633
2026-01-27 21:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd763ab0-1bbb-51c1-9989-09a90bc43b7f with identifier: NV95469
2026-01-27 21:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd763ab0-1bbb-51c1-9989-09a90bc43b7f with scrape type 2
2026-01-27 21:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd763ab0-1bbb-51c1-9989-09a90bc43b7f with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd763ab0-1bbb-51c1-9989-09a90bc43b7f, identifier: NV95469
2026-01-27 21:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 313d8250-41d1-5f33-9d8b-fe99f1264e2e with identifier: AM19633
2026-01-27 21:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 313d8250-41d1-5f33-9d8b-fe99f1264e2e with identifier: AM19633
2026-01-27 21:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 313d8250-41d1-5f33-9d8b-fe99f1264e2e with identifier: AM19633 to the API
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM19633>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '1.0L',
'engine_horse_power': 71,
'expiration_date': '2026-01-28T16:48:12Z',
'fuel_type': 'petrol',
'id': '313d8250-41d1-5f33-9d8b-fe99f1264e2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM19633',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Nissan',
'model': 'Micra',
'odometer': 52144,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Micra 1.0 Visia Pack',
'transmission': 'manual',
'trim': 'Visia Pack',
'year': 2019}
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM19633%27 HTTP/1.1" 200 None
2026-01-27 21:00:40 [auto1.it] INFO: Saving data for AM19633: {'auction_closing_time': 1769618892.0, 'created_time': 1768989811.484025, 'last_price_update_time': 1769547640.373383}
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AM19633') HTTP/1.1" 204 0
2026-01-27 21:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd763ab0-1bbb-51c1-9989-09a90bc43b7f with identifier: NV95469
2026-01-27 21:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd763ab0-1bbb-51c1-9989-09a90bc43b7f with identifier: NV95469
2026-01-27 21:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186486 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
186486
2026-01-27 21:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cd763ab0-1bbb-51c1-9989-09a90bc43b7f spider: auto1.it
2026-01-27 21:00:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: cd763ab0-1bbb-51c1-9989-09a90bc43b7f due to rule: high_mileage_for_country.json, error: 186486 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
186486
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:28:52Z',
'fuel_type': 'petrol',
'id': 'cd763ab0-1bbb-51c1-9989-09a90bc43b7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV95469',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Ford',
'model': 'Kuga',
'odometer': 186486,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2019}
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV95469%27 HTTP/1.1" 200 None
2026-01-27 21:00:40 [auto1.it] INFO: Saving data for NV95469: {'auction_closing_time': 1769617732.0, 'created_time': 1769458195.458226, 'last_price_update_time': 1769547640.610057}
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV95469') HTTP/1.1" 204 0
2026-01-27 21:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA77465> (referer: https://www.auto1.com/v1/car-details-view/LA77465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d with identifier: LZ66498
2026-01-27 21:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d, identifier: LZ66498
2026-01-27 21:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eca80ac-f303-50d0-bb23-e3f32c1ba78a with identifier: RL99937
2026-01-27 21:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eca80ac-f303-50d0-bb23-e3f32c1ba78a with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eca80ac-f303-50d0-bb23-e3f32c1ba78a with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8eca80ac-f303-50d0-bb23-e3f32c1ba78a, identifier: RL99937
2026-01-27 21:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e3e823-440f-55fc-a5a1-0fbd88c45b08 with identifier: NA73854
2026-01-27 21:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e3e823-440f-55fc-a5a1-0fbd88c45b08 with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8e3e823-440f-55fc-a5a1-0fbd88c45b08 with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8e3e823-440f-55fc-a5a1-0fbd88c45b08, identifier: NA73854
2026-01-27 21:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c8d0aad-ec4d-5b3d-b4e7-936076e25e12 with identifier: KZ89733
2026-01-27 21:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c8d0aad-ec4d-5b3d-b4e7-936076e25e12 with scrape type 2
2026-01-27 21:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c8d0aad-ec4d-5b3d-b4e7-936076e25e12 with scrape type 2
2026-01-27 21:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c8d0aad-ec4d-5b3d-b4e7-936076e25e12, identifier: KZ89733
2026-01-27 21:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d with identifier: LZ66498
2026-01-27 21:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d with identifier: LZ66498
2026-01-27 21:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d with identifier: LZ66498 to the API
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ66498>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 218,
'expiration_date': '2026-01-28T16:08:27Z',
'fuel_type': 'hybrid',
'id': 'e62056e7-b8b7-5d7b-ac9c-e54af2a25f1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ66498',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 21229,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ66498%27 HTTP/1.1" 200 None
2026-01-27 21:00:41 [auto1.it] INFO: Saving data for LZ66498: {'auction_closing_time': 1769616507.0, 'created_time': 1768507562.943459, 'last_price_update_time': 1769547641.403765}
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ66498') HTTP/1.1" 204 0
2026-01-27 21:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8eca80ac-f303-50d0-bb23-e3f32c1ba78a with identifier: RL99937
2026-01-27 21:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8eca80ac-f303-50d0-bb23-e3f32c1ba78a with identifier: RL99937
2026-01-27 21:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8eca80ac-f303-50d0-bb23-e3f32c1ba78a with identifier: RL99937 to the API
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL99937>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:26:07Z',
'fuel_type': 'diesel',
'id': '8eca80ac-f303-50d0-bb23-e3f32c1ba78a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL99937',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 148717,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2021}
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL99937%27 HTTP/1.1" 200 None
2026-01-27 21:00:41 [auto1.it] INFO: Saving data for RL99937: {'auction_closing_time': 1769617567.0, 'created_time': 1768212061.449583, 'last_price_update_time': 1769547641.704914}
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL99937') HTTP/1.1" 204 0
2026-01-27 21:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8e3e823-440f-55fc-a5a1-0fbd88c45b08 with identifier: NA73854
2026-01-27 21:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8e3e823-440f-55fc-a5a1-0fbd88c45b08 with identifier: NA73854
2026-01-27 21:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e8e3e823-440f-55fc-a5a1-0fbd88c45b08 with identifier: NA73854 to the API
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA73854>
{'auction_title': '',
'c_o_2_emission_value': 49,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 392,
'expiration_date': '2026-01-28T16:36:44Z',
'fuel_type': 'hybrid',
'id': 'e8e3e823-440f-55fc-a5a1-0fbd88c45b08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA73854',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volvo',
'model': 'V90',
'odometer': 113689,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V90 2.0 T8 Plug-in Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2018}
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA73854%27 HTTP/1.1" 200 None
2026-01-27 21:00:42 [auto1.it] INFO: Saving data for NA73854: {'auction_closing_time': 1769618204.0, 'created_time': 1767816182.919208, 'last_price_update_time': 1769547642.044526}
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA73854') HTTP/1.1" 204 0
2026-01-27 21:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c8d0aad-ec4d-5b3d-b4e7-936076e25e12 with identifier: KZ89733
2026-01-27 21:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c8d0aad-ec4d-5b3d-b4e7-936076e25e12 with identifier: KZ89733
2026-01-27 21:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c8d0aad-ec4d-5b3d-b4e7-936076e25e12 with identifier: KZ89733 to the API
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ89733>
{'auction_title': '',
'c_o_2_emission_value': 43,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 220,
'expiration_date': '2026-01-28T16:33:23Z',
'fuel_type': 'hybrid',
'id': '2c8d0aad-ec4d-5b3d-b4e7-936076e25e12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ89733',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'BMW',
'model': 'X2',
'odometer': 90323,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X2 xDrive 25e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ89733%27 HTTP/1.1" 200 None
2026-01-27 21:00:42 [auto1.it] INFO: Saving data for KZ89733: {'auction_closing_time': 1769618003.0, 'created_time': 1769025658.705076, 'last_price_update_time': 1769547642.349673}
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ89733') HTTP/1.1" 204 0
2026-01-27 21:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV83223> (referer: https://www.auto1.com/v1/car-details-view/SV83223/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465
2026-01-27 21:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18cb58d6-7632-5eda-88c1-cd2927e2523e with scrape type 2
2026-01-27 21:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18cb58d6-7632-5eda-88c1-cd2927e2523e with scrape type 2
2026-01-27 21:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18cb58d6-7632-5eda-88c1-cd2927e2523e, identifier: LA77465
2026-01-27 21:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465
2026-01-27 21:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465
2026-01-27 21:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18cb58d6-7632-5eda-88c1-cd2927e2523e with identifier: LA77465 to the API
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA77465>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-01-28T16:46:40Z',
'fuel_type': 'diesel',
'id': '18cb58d6-7632-5eda-88c1-cd2927e2523e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA77465',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'BMW',
'model': 'X5',
'odometer': 113896,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA77465%27 HTTP/1.1" 200 None
2026-01-27 21:00:42 [auto1.it] INFO: Saving data for LA77465: {'auction_closing_time': 1769618800.0, 'created_time': 1768248453.843478, 'last_price_update_time': 1769547642.781425}
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA77465') HTTP/1.1" 204 0
2026-01-27 21:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9773284c-90a0-5106-8cd6-32b7916fe45b with identifier: SV83223
2026-01-27 21:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9773284c-90a0-5106-8cd6-32b7916fe45b with scrape type 2
2026-01-27 21:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9773284c-90a0-5106-8cd6-32b7916fe45b with scrape type 2
2026-01-27 21:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9773284c-90a0-5106-8cd6-32b7916fe45b, identifier: SV83223
2026-01-27 21:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9773284c-90a0-5106-8cd6-32b7916fe45b with identifier: SV83223
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-01-27 21:00:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9773284c-90a0-5106-8cd6-32b7916fe45b with identifier: SV83223
2026-01-27 21:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9773284c-90a0-5106-8cd6-32b7916fe45b with identifier: SV83223 to the API
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV83223>
{'auction_title': '',
'c_o_2_emission_value': 88,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-01-28T16:34:46Z',
'fuel_type': 'petrol',
'id': '9773284c-90a0-5106-8cd6-32b7916fe45b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV83223',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Citroen',
'model': 'C1',
'odometer': 28559,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-29',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0 VTi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2020}
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV83223%27 HTTP/1.1" 200 None
2026-01-27 21:00:43 [auto1.it] INFO: Saving data for SV83223: {'auction_closing_time': 1769618086.0, 'created_time': 1769457645.158435, 'last_price_update_time': 1769547643.353309}
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV83223') HTTP/1.1" 204 0
2026-01-27 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ51611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW70389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA13828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB93346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH97733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC49828> (referer: https://www.auto1.com/v1/car-details-view/GC49828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a88e662c-8fd8-5d12-9c33-6b2bedfcc2de with identifier: GC49828
2026-01-27 21:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a88e662c-8fd8-5d12-9c33-6b2bedfcc2de with scrape type 2
2026-01-27 21:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a88e662c-8fd8-5d12-9c33-6b2bedfcc2de with scrape type 2
2026-01-27 21:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a88e662c-8fd8-5d12-9c33-6b2bedfcc2de, identifier: GC49828
2026-01-27 21:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a88e662c-8fd8-5d12-9c33-6b2bedfcc2de with identifier: GC49828
2026-01-27 21:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a88e662c-8fd8-5d12-9c33-6b2bedfcc2de with identifier: GC49828
2026-01-27 21:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a88e662c-8fd8-5d12-9c33-6b2bedfcc2de with identifier: GC49828 to the API
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GC49828>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.8L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:56:30Z',
'fuel_type': 'diesel',
'id': 'a88e662c-8fd8-5d12-9c33-6b2bedfcc2de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC49828',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 115497,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-3 1.8 Skyactiv-D Exceed',
'transmission': 'manual',
'trim': 'Exceed',
'year': 2019}
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC49828%27 HTTP/1.1" 200 None
2026-01-27 21:00:43 [auto1.it] INFO: Saving data for GC49828: {'auction_closing_time': 1769619390.0, 'created_time': 1769457771.782979, 'last_price_update_time': 1769547643.895052}
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC49828') HTTP/1.1" 204 0
2026-01-27 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY28433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX49357> (referer: https://www.auto1.com/v1/car-details-view/FX49357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1789469-5a9e-5ec7-b3e6-a42cb513687f with identifier: FX49357
2026-01-27 21:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1789469-5a9e-5ec7-b3e6-a42cb513687f with scrape type 2
2026-01-27 21:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1789469-5a9e-5ec7-b3e6-a42cb513687f with scrape type 2
2026-01-27 21:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1789469-5a9e-5ec7-b3e6-a42cb513687f, identifier: FX49357
2026-01-27 21:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1789469-5a9e-5ec7-b3e6-a42cb513687f with identifier: FX49357
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-01-27 21:00:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-01-27 21:00:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1789469-5a9e-5ec7-b3e6-a42cb513687f with identifier: FX49357
2026-01-27 21:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1789469-5a9e-5ec7-b3e6-a42cb513687f with identifier: FX49357 to the API
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FX49357>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:10:26Z',
'fuel_type': 'gas',
'id': 'a1789469-5a9e-5ec7-b3e6-a42cb513687f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX49357',
'listing': 'auction',
'location': 'IT, Modugno',
'make': 'Dacia',
'model': 'Duster',
'odometer': 54102,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Extreme',
'transmission': 'manual',
'trim': 'Extreme',
'year': 2023}
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX49357%27 HTTP/1.1" 200 None
2026-01-27 21:00:45 [auto1.it] INFO: Saving data for FX49357: {'auction_closing_time': 1769616626.0, 'created_time': 1769458198.763848, 'last_price_update_time': 1769547645.08449}
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FX49357') HTTP/1.1" 204 0
2026-01-27 21:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN76838> (referer: https://www.auto1.com/v1/car-details-view/JN76838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ25760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT68594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE79301/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA43401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT38292> (referer: https://www.auto1.com/v1/car-details-view/VT38292/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB81856> (referer: https://www.auto1.com/v1/car-details-view/RB81856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1660c023-23ac-5619-bb62-b3628eb02ce7 with identifier: JN76838
2026-01-27 21:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1660c023-23ac-5619-bb62-b3628eb02ce7 with scrape type 2
2026-01-27 21:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1660c023-23ac-5619-bb62-b3628eb02ce7 with scrape type 2
2026-01-27 21:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1660c023-23ac-5619-bb62-b3628eb02ce7, identifier: JN76838
2026-01-27 21:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1660c023-23ac-5619-bb62-b3628eb02ce7 with identifier: JN76838
2026-01-27 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1660c023-23ac-5619-bb62-b3628eb02ce7 with identifier: JN76838
2026-01-27 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179814 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
179814
2026-01-27 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1660c023-23ac-5619-bb62-b3628eb02ce7 spider: auto1.it
2026-01-27 21:00:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 1660c023-23ac-5619-bb62-b3628eb02ce7 due to rule: high_mileage_for_country.json, error: 179814 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
179814
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-01-28T16:11:58Z',
'fuel_type': 'diesel',
'id': '1660c023-23ac-5619-bb62-b3628eb02ce7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN76838',
'listing': 'auction',
'location': 'IT, Modugno',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 179814,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN76838%27 HTTP/1.1" 200 None
2026-01-27 21:00:45 [auto1.it] INFO: Saving data for JN76838: {'auction_closing_time': 1769616718.0, 'created_time': 1769458343.926507, 'last_price_update_time': 1769547645.516391}
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN76838') HTTP/1.1" 204 0
2026-01-27 21:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4d4fb69-0442-578e-ae30-e855d69f020a with identifier: VT38292
2026-01-27 21:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4d4fb69-0442-578e-ae30-e855d69f020a with scrape type 2
2026-01-27 21:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4d4fb69-0442-578e-ae30-e855d69f020a with scrape type 2
2026-01-27 21:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4d4fb69-0442-578e-ae30-e855d69f020a, identifier: VT38292
2026-01-27 21:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4d4fb69-0442-578e-ae30-e855d69f020a with identifier: VT38292
2026-01-27 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4d4fb69-0442-578e-ae30-e855d69f020a with identifier: VT38292
2026-01-27 21:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4d4fb69-0442-578e-ae30-e855d69f020a with identifier: VT38292 to the API
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT38292>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-01-28T16:37:23Z',
'fuel_type': 'petrol',
'id': 'd4d4fb69-0442-578e-ae30-e855d69f020a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT38292',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Citroen',
'model': 'C3',
'odometer': 86388,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-04',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2020}
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT38292%27 HTTP/1.1" 200 None
2026-01-27 21:00:45 [auto1.it] INFO: Saving data for VT38292: {'auction_closing_time': 1769618243.0, 'created_time': 1769458489.929628, 'last_price_update_time': 1769547645.911115}
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VT38292') HTTP/1.1" 204 0
2026-01-27 21:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925479fe-2ce0-514a-b656-24c270f2ba6d with identifier: RB81856
2026-01-27 21:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925479fe-2ce0-514a-b656-24c270f2ba6d with scrape type 2
2026-01-27 21:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 925479fe-2ce0-514a-b656-24c270f2ba6d with scrape type 2
2026-01-27 21:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 925479fe-2ce0-514a-b656-24c270f2ba6d, identifier: RB81856
2026-01-27 21:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 925479fe-2ce0-514a-b656-24c270f2ba6d with identifier: RB81856
2026-01-27 21:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 925479fe-2ce0-514a-b656-24c270f2ba6d with identifier: RB81856
2026-01-27 21:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 925479fe-2ce0-514a-b656-24c270f2ba6d with identifier: RB81856 to the API
2026-01-27 21:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RB81856>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:38:28Z',
'fuel_type': 'petrol',
'id': '925479fe-2ce0-514a-b656-24c270f2ba6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB81856',
'listing': 'auction',
'location': 'IT, Roma (RM)',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 29615,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Ultimate',
'transmission': 'manual',
'trim': 'Ultimate',
'year': 2023}
2026-01-27 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB81856%27 HTTP/1.1" 200 None
2026-01-27 21:00:46 [auto1.it] INFO: Saving data for RB81856: {'auction_closing_time': 1769618308.0, 'created_time': 1769457825.381247, 'last_price_update_time': 1769547646.321087}
2026-01-27 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB81856') HTTP/1.1" 204 0
2026-01-27 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG41952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL25385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW29655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB21485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX45481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH97733> (referer: https://www.auto1.com/v1/car-details-view/VH97733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ26704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP03591> (referer: https://www.auto1.com/v1/car-details-view/PP03591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733
2026-01-27 21:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with scrape type 2
2026-01-27 21:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with scrape type 2
2026-01-27 21:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb1bdb37-0f40-5444-8d30-20f1f3f9c845, identifier: VH97733
2026-01-27 21:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-01-27 21:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733
2026-01-27 21:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb1bdb37-0f40-5444-8d30-20f1f3f9c845 with identifier: VH97733 to the API
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH97733>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:53:25Z',
'fuel_type': 'diesel',
'id': 'bb1bdb37-0f40-5444-8d30-20f1f3f9c845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH97733',
'listing': 'auction',
'location': 'IT, Modugno',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 123971,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Bose Edition',
'transmission': 'automatic',
'trim': 'Bose Edition',
'year': 2018}
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH97733%27 HTTP/1.1" 200 None
2026-01-27 21:00:47 [auto1.it] INFO: Saving data for VH97733: {'auction_closing_time': 1769619205.0, 'created_time': 1769458526.284145, 'last_price_update_time': 1769547647.784439}
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH97733') HTTP/1.1" 204 0
2026-01-27 21:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591
2026-01-27 21:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a62b49a-69fa-52f4-a787-2c48576ed20b with scrape type 2
2026-01-27 21:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a62b49a-69fa-52f4-a787-2c48576ed20b with scrape type 2
2026-01-27 21:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a62b49a-69fa-52f4-a787-2c48576ed20b, identifier: PP03591
2026-01-27 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY28433> (referer: https://www.auto1.com/v1/car-details-view/JY28433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB93346> (referer: https://www.auto1.com/v1/car-details-view/MB93346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591
2026-01-27 21:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591
2026-01-27 21:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a62b49a-69fa-52f4-a787-2c48576ed20b with identifier: PP03591 to the API
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PP03591>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2026-01-28T16:57:26Z',
'fuel_type': 'petrol',
'id': '3a62b49a-69fa-52f4-a787-2c48576ed20b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP03591',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'BMW',
'model': '1er',
'odometer': 42954,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP03591%27 HTTP/1.1" 200 None
2026-01-27 21:00:48 [auto1.it] INFO: Saving data for PP03591: {'auction_closing_time': 1769619446.0, 'created_time': 1769458142.003982, 'last_price_update_time': 1769547648.26423}
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP03591') HTTP/1.1" 204 0
2026-01-27 21:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA13828> (referer: https://www.auto1.com/v1/car-details-view/CA13828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f2052b-1108-5814-a739-a55d71e07b1b with identifier: JY28433
2026-01-27 21:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f2052b-1108-5814-a739-a55d71e07b1b with scrape type 2
2026-01-27 21:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90f2052b-1108-5814-a739-a55d71e07b1b with scrape type 2
2026-01-27 21:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90f2052b-1108-5814-a739-a55d71e07b1b, identifier: JY28433
2026-01-27 21:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 292171ef-8467-559d-aa57-bbf5f7d2a270 with identifier: MB93346
2026-01-27 21:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 292171ef-8467-559d-aa57-bbf5f7d2a270 with scrape type 2
2026-01-27 21:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 292171ef-8467-559d-aa57-bbf5f7d2a270 with scrape type 2
2026-01-27 21:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 292171ef-8467-559d-aa57-bbf5f7d2a270, identifier: MB93346
2026-01-27 21:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90f2052b-1108-5814-a739-a55d71e07b1b with identifier: JY28433
2026-01-27 21:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90f2052b-1108-5814-a739-a55d71e07b1b with identifier: JY28433
2026-01-27 21:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90f2052b-1108-5814-a739-a55d71e07b1b with identifier: JY28433 to the API
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JY28433>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 136,
'expiration_date': '2026-01-28T16:08:51Z',
'fuel_type': 'petrol',
'id': '90f2052b-1108-5814-a739-a55d71e07b1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY28433',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Subaru',
'model': 'Crosstrek',
'odometer': 1225,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Crosstrek 2.0 Mild-Hybrid Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2025}
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY28433%27 HTTP/1.1" 200 None
2026-01-27 21:00:48 [auto1.it] INFO: Saving data for JY28433: {'auction_closing_time': 1769616531.0, 'created_time': 1769025855.611393, 'last_price_update_time': 1769547648.784649}
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JY28433') HTTP/1.1" 204 0
2026-01-27 21:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 292171ef-8467-559d-aa57-bbf5f7d2a270 with identifier: MB93346
2026-01-27 21:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 292171ef-8467-559d-aa57-bbf5f7d2a270 with identifier: MB93346
2026-01-27 21:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 292171ef-8467-559d-aa57-bbf5f7d2a270 with identifier: MB93346 to the API
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB93346>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 162,
'expiration_date': '2026-01-28T16:21:13Z',
'fuel_type': 'petrol',
'id': '292171ef-8467-559d-aa57-bbf5f7d2a270',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB93346',
'listing': 'auction',
'location': 'IT, Ferrara',
'make': 'MG',
'model': 'HS',
'odometer': 27151,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'MG HS 1.5 Luxury',
'transmission': 'manual',
'trim': 'Luxury',
'year': 2023}
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB93346%27 HTTP/1.1" 200 None
2026-01-27 21:00:49 [auto1.it] INFO: Saving data for MB93346: {'auction_closing_time': 1769617273.0, 'created_time': 1769458145.695824, 'last_price_update_time': 1769547649.084418}
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB93346') HTTP/1.1" 204 0
2026-01-27 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB20175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH01069> (referer: https://www.auto1.com/v1/car-details-view/EH01069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA91703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW70389> (referer: https://www.auto1.com/v1/car-details-view/UW70389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ51611> (referer: https://www.auto1.com/v1/car-details-view/LZ51611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0251bfd-efab-513a-8bac-81d52f950c8b with identifier: CA13828
2026-01-27 21:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0251bfd-efab-513a-8bac-81d52f950c8b with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0251bfd-efab-513a-8bac-81d52f950c8b with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0251bfd-efab-513a-8bac-81d52f950c8b, identifier: CA13828
2026-01-27 21:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0251bfd-efab-513a-8bac-81d52f950c8b with identifier: CA13828
2026-01-27 21:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0251bfd-efab-513a-8bac-81d52f950c8b with identifier: CA13828
2026-01-27 21:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0251bfd-efab-513a-8bac-81d52f950c8b with identifier: CA13828 to the API
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA13828>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2026-01-28T16:05:50Z',
'fuel_type': 'petrol',
'id': 'd0251bfd-efab-513a-8bac-81d52f950c8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA13828',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Renault',
'model': 'Clio',
'odometer': 29922,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2021}
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA13828%27 HTTP/1.1" 200 None
2026-01-27 21:00:49 [auto1.it] INFO: Saving data for CA13828: {'auction_closing_time': 1769616350.0, 'created_time': 1769458018.176214, 'last_price_update_time': 1769547649.513307}
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA13828') HTTP/1.1" 204 0
2026-01-27 21:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069
2026-01-27 21:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9, identifier: EH01069
2026-01-27 21:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eddb9589-ee46-5c2f-ae8b-8aa96ae91c08 with identifier: UW70389
2026-01-27 21:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eddb9589-ee46-5c2f-ae8b-8aa96ae91c08 with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eddb9589-ee46-5c2f-ae8b-8aa96ae91c08 with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eddb9589-ee46-5c2f-ae8b-8aa96ae91c08, identifier: UW70389
2026-01-27 21:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d2279a-c686-53cc-93c5-0055c005bc37 with identifier: LZ51611
2026-01-27 21:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d2279a-c686-53cc-93c5-0055c005bc37 with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8d2279a-c686-53cc-93c5-0055c005bc37 with scrape type 2
2026-01-27 21:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8d2279a-c686-53cc-93c5-0055c005bc37, identifier: LZ51611
2026-01-27 21:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069
2026-01-27 21:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069
2026-01-27 21:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd6d4825-f40e-58e4-9909-9d0c53b6bfc9 with identifier: EH01069 to the API
2026-01-27 21:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH01069>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-01-28T16:51:32Z',
'fuel_type': 'diesel',
'id': 'dd6d4825-f40e-58e4-9909-9d0c53b6bfc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH01069',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volvo',
'model': 'XC60',
'odometer': 104259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Core 2WD',
'transmission': 'automatic',
'trim': 'Core 2WD',
'year': 2022}
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH01069%27 HTTP/1.1" 200 None
2026-01-27 21:00:50 [auto1.it] INFO: Saving data for EH01069: {'auction_closing_time': 1769619092.0, 'created_time': 1768464058.500176, 'last_price_update_time': 1769547650.109567}
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH01069') HTTP/1.1" 204 0
2026-01-27 21:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eddb9589-ee46-5c2f-ae8b-8aa96ae91c08 with identifier: UW70389
2026-01-27 21:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eddb9589-ee46-5c2f-ae8b-8aa96ae91c08 with identifier: UW70389
2026-01-27 21:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eddb9589-ee46-5c2f-ae8b-8aa96ae91c08 with identifier: UW70389 to the API
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW70389>
{'auction_title': '',
'c_o_2_emission_value': 36,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-01-28T16:12:53Z',
'fuel_type': 'hybrid',
'id': 'eddb9589-ee46-5c2f-ae8b-8aa96ae91c08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW70389',
'listing': 'auction',
'location': 'IT, Avezzano',
'make': 'Peugeot',
'model': '508',
'odometer': 48857,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 1.6 Hybrid 225 GT',
'transmission': 'automatic',
'trim': '225 GT',
'year': 2020}
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW70389%27 HTTP/1.1" 200 None
2026-01-27 21:00:50 [auto1.it] INFO: Saving data for UW70389: {'auction_closing_time': 1769616773.0, 'created_time': 1769457898.329553, 'last_price_update_time': 1769547650.403951}
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW70389') HTTP/1.1" 204 0
2026-01-27 21:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8d2279a-c686-53cc-93c5-0055c005bc37 with identifier: LZ51611
2026-01-27 21:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8d2279a-c686-53cc-93c5-0055c005bc37 with identifier: LZ51611
2026-01-27 21:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b8d2279a-c686-53cc-93c5-0055c005bc37 with identifier: LZ51611 to the API
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ51611>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-01-28T16:23:22Z',
'fuel_type': 'petrol',
'id': 'b8d2279a-c686-53cc-93c5-0055c005bc37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ51611',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 11262,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-30',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Trendy',
'transmission': 'automatic',
'trim': 'Trendy',
'year': 2023}
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ51611%27 HTTP/1.1" 200 None
2026-01-27 21:00:50 [auto1.it] INFO: Saving data for LZ51611: {'auction_closing_time': 1769617402.0, 'created_time': 1769458014.092372, 'last_price_update_time': 1769547650.757057}
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ51611') HTTP/1.1" 204 0
2026-01-27 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA43401> (referer: https://www.auto1.com/v1/car-details-view/EA43401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG41952> (referer: https://www.auto1.com/v1/car-details-view/MG41952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL25385> (referer: https://www.auto1.com/v1/car-details-view/UL25385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d0f276-0b21-5af2-8f92-7d8f3f648083 with identifier: EA43401
2026-01-27 21:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d0f276-0b21-5af2-8f92-7d8f3f648083 with scrape type 2
2026-01-27 21:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82d0f276-0b21-5af2-8f92-7d8f3f648083 with scrape type 2
2026-01-27 21:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82d0f276-0b21-5af2-8f92-7d8f3f648083, identifier: EA43401
2026-01-27 21:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82d0f276-0b21-5af2-8f92-7d8f3f648083 with identifier: EA43401
2026-01-27 21:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82d0f276-0b21-5af2-8f92-7d8f3f648083 with identifier: EA43401
2026-01-27 21:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82d0f276-0b21-5af2-8f92-7d8f3f648083 with identifier: EA43401 to the API
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA43401>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:08:38Z',
'fuel_type': 'petrol',
'id': '82d0f276-0b21-5af2-8f92-7d8f3f648083',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA43401',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 46290,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2022}
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA43401%27 HTTP/1.1" 200 None
2026-01-27 21:00:51 [auto1.it] INFO: Saving data for EA43401: {'auction_closing_time': 1769616518.0, 'created_time': 1769457705.166011, 'last_price_update_time': 1769547651.297586}
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA43401') HTTP/1.1" 204 0
2026-01-27 21:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952
2026-01-27 21:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedb1903-f8e0-58ee-8d20-04e44bf832f6 with scrape type 2
2026-01-27 21:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cedb1903-f8e0-58ee-8d20-04e44bf832f6 with scrape type 2
2026-01-27 21:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cedb1903-f8e0-58ee-8d20-04e44bf832f6, identifier: MG41952
2026-01-27 21:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385
2026-01-27 21:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with scrape type 2
2026-01-27 21:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with scrape type 2
2026-01-27 21:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf, identifier: UL25385
2026-01-27 21:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952
2026-01-27 21:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952
2026-01-27 21:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cedb1903-f8e0-58ee-8d20-04e44bf832f6 with identifier: MG41952 to the API
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MG41952>
{'auction_title': '',
'c_o_2_emission_value': 185,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 245,
'expiration_date': '2026-01-28T16:50:36Z',
'fuel_type': 'petrol',
'id': 'cedb1903-f8e0-58ee-8d20-04e44bf832f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG41952',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Porsche',
'model': 'Macan',
'odometer': 132397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan Basis',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG41952%27 HTTP/1.1" 200 None
2026-01-27 21:00:51 [auto1.it] INFO: Saving data for MG41952: {'auction_closing_time': 1769619036.0, 'created_time': 1768594215.794878, 'last_price_update_time': 1769547651.796329}
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MG41952') HTTP/1.1" 204 0
2026-01-27 21:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385
2026-01-27 21:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385
2026-01-27 21:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd8eabf6-68b8-5da5-b9b1-e2b0325113cf with identifier: UL25385 to the API
2026-01-27 21:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL25385>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 300,
'expiration_date': '2026-01-28T16:58:42Z',
'fuel_type': 'hybrid',
'id': 'dd8eabf6-68b8-5da5-b9b1-e2b0325113cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL25385',
'listing': 'auction',
'location': "IT, Fiorenzuola D'Arda (PC)",
'make': 'Opel',
'model': 'Grandland X',
'odometer': 125039,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.6 Plug-in Hybrid 4 Design Line',
'transmission': 'automatic',
'trim': 'Design Line',
'year': 2021}
2026-01-27 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL25385%27 HTTP/1.1" 200 None
2026-01-27 21:00:52 [auto1.it] INFO: Saving data for UL25385: {'auction_closing_time': 1769619522.0, 'created_time': 1769457901.997524, 'last_price_update_time': 1769547652.107773}
2026-01-27 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL25385') HTTP/1.1" 204 0
2026-01-27 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW29655> (referer: https://www.auto1.com/v1/car-details-view/ZW29655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT68594> (referer: https://www.auto1.com/v1/car-details-view/DT68594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE79301> (referer: https://www.auto1.com/v1/car-details-view/EE79301/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ25760> (referer: https://www.auto1.com/v1/car-details-view/LZ25760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB21485> (referer: https://www.auto1.com/v1/car-details-view/UB21485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f2f4515-1cd4-5ec4-994a-bed621df0e56 with identifier: ZW29655
2026-01-27 21:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f2f4515-1cd4-5ec4-994a-bed621df0e56 with scrape type 2
2026-01-27 21:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f2f4515-1cd4-5ec4-994a-bed621df0e56 with scrape type 2
2026-01-27 21:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f2f4515-1cd4-5ec4-994a-bed621df0e56, identifier: ZW29655
2026-01-27 21:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5689b898-60ed-5e4f-90c4-afa6d8a9c48e with identifier: DT68594
2026-01-27 21:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5689b898-60ed-5e4f-90c4-afa6d8a9c48e with scrape type 2
2026-01-27 21:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5689b898-60ed-5e4f-90c4-afa6d8a9c48e with scrape type 2
2026-01-27 21:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5689b898-60ed-5e4f-90c4-afa6d8a9c48e, identifier: DT68594
2026-01-27 21:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa61e282-d129-5469-b770-ecfb877c7051 with identifier: EE79301
2026-01-27 21:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa61e282-d129-5469-b770-ecfb877c7051 with scrape type 2
2026-01-27 21:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa61e282-d129-5469-b770-ecfb877c7051 with scrape type 2
2026-01-27 21:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa61e282-d129-5469-b770-ecfb877c7051, identifier: EE79301
2026-01-27 21:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f2f4515-1cd4-5ec4-994a-bed621df0e56 with identifier: ZW29655
2026-01-27 21:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f2f4515-1cd4-5ec4-994a-bed621df0e56 with identifier: ZW29655
2026-01-27 21:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f2f4515-1cd4-5ec4-994a-bed621df0e56 with identifier: ZW29655 to the API
2026-01-27 21:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZW29655>
{'auction_title': '',
'c_o_2_emission_value': 190,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 320,
'expiration_date': '2026-01-28T16:52:17Z',
'fuel_type': 'diesel',
'id': '7f2f4515-1cd4-5ec4-994a-bed621df0e56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW29655',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'BMW',
'model': '8er',
'odometer': 121695,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 8er 840d Gran Coupe xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2020}
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW29655%27 HTTP/1.1" 200 None
2026-01-27 21:00:53 [auto1.it] INFO: Saving data for ZW29655: {'auction_closing_time': 1769619137.0, 'created_time': 1769458166.099067, 'last_price_update_time': 1769547653.424801}
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZW29655') HTTP/1.1" 204 0
2026-01-27 21:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5689b898-60ed-5e4f-90c4-afa6d8a9c48e with identifier: DT68594
2026-01-27 21:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5689b898-60ed-5e4f-90c4-afa6d8a9c48e with identifier: DT68594
2026-01-27 21:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5689b898-60ed-5e4f-90c4-afa6d8a9c48e with identifier: DT68594 to the API
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT68594>
{'auction_title': '',
'c_o_2_emission_value': 48,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 292,
'expiration_date': '2026-01-28T16:08:58Z',
'fuel_type': 'hybrid',
'id': '5689b898-60ed-5e4f-90c4-afa6d8a9c48e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT68594',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'BMW',
'model': 'X3',
'odometer': 120453,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 30e xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2020}
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT68594%27 HTTP/1.1" 200 None
2026-01-27 21:00:53 [auto1.it] INFO: Saving data for DT68594: {'auction_closing_time': 1769616538.0, 'created_time': 1768939255.956835, 'last_price_update_time': 1769547653.736215}
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT68594') HTTP/1.1" 204 0
2026-01-27 21:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa61e282-d129-5469-b770-ecfb877c7051 with identifier: EE79301
2026-01-27 21:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa61e282-d129-5469-b770-ecfb877c7051 with identifier: EE79301
2026-01-27 21:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa61e282-d129-5469-b770-ecfb877c7051 with identifier: EE79301 to the API
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EE79301>
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:11:13Z',
'fuel_type': 'petrol',
'id': 'fa61e282-d129-5469-b770-ecfb877c7051',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE79301',
'listing': 'auction',
'location': 'IT, Rende',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 47461,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE79301%27 HTTP/1.1" 200 None
2026-01-27 21:00:54 [auto1.it] INFO: Saving data for EE79301: {'auction_closing_time': 1769616673.0, 'created_time': 1769457991.373485, 'last_price_update_time': 1769547654.033394}
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE79301') HTTP/1.1" 204 0
2026-01-27 21:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760
2026-01-27 21:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with scrape type 2
2026-01-27 21:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with scrape type 2
2026-01-27 21:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7, identifier: LZ25760
2026-01-27 21:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760
2026-01-27 21:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760
2026-01-27 21:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7 with identifier: LZ25760 to the API
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ25760>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 292,
'expiration_date': '2026-01-28T16:48:40Z',
'fuel_type': 'hybrid',
'id': 'ebef40c4-f2d2-5f6a-a74a-b0a29b8dccf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ25760',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'BMW',
'model': '5er',
'odometer': 86538,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530e xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2021}
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2026-01-27 21:00:54 [auto1.it] INFO: Saving data for LZ25760: {'auction_closing_time': 1769618920.0, 'created_time': 1769026119.441657, 'last_price_update_time': 1769547654.409437}
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ25760') HTTP/1.1" 204 0
2026-01-27 21:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN59549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ26704> (referer: https://www.auto1.com/v1/car-details-view/DZ26704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX45481> (referer: https://www.auto1.com/v1/car-details-view/SX45481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf896faf-201f-51a3-88fd-827d20440a84 with identifier: UB21485
2026-01-27 21:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf896faf-201f-51a3-88fd-827d20440a84 with scrape type 2
2026-01-27 21:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf896faf-201f-51a3-88fd-827d20440a84 with scrape type 2
2026-01-27 21:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf896faf-201f-51a3-88fd-827d20440a84, identifier: UB21485
2026-01-27 21:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf896faf-201f-51a3-88fd-827d20440a84 with identifier: UB21485
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:00:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-01-27 21:00:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf896faf-201f-51a3-88fd-827d20440a84 with identifier: UB21485
2026-01-27 21:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf896faf-201f-51a3-88fd-827d20440a84 with identifier: UB21485 to the API
2026-01-27 21:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB21485>
{'auction_title': '',
'c_o_2_emission_value': 229,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 265,
'expiration_date': '2026-01-28T16:05:06Z',
'fuel_type': 'petrol',
'id': 'bf896faf-201f-51a3-88fd-827d20440a84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB21485',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Porsche',
'model': 'Macan',
'odometer': 70353,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan 2.0',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-01-27 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB21485%27 HTTP/1.1" 200 None
2026-01-27 21:00:55 [auto1.it] INFO: Saving data for UB21485: {'auction_closing_time': 1769616306.0, 'created_time': 1769457951.525078, 'last_price_update_time': 1769547655.611491}
2026-01-27 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB21485') HTTP/1.1" 204 0
2026-01-27 21:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR47536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA56454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE37664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL58155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC16084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a7d682-c8ea-5a08-b3df-c525bad44783 with identifier: DZ26704
2026-01-27 21:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a7d682-c8ea-5a08-b3df-c525bad44783 with scrape type 2
2026-01-27 21:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a7d682-c8ea-5a08-b3df-c525bad44783 with scrape type 2
2026-01-27 21:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9a7d682-c8ea-5a08-b3df-c525bad44783, identifier: DZ26704
2026-01-27 21:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de8c3d4e-bad4-5388-a06d-020af83dad1d with identifier: SX45481
2026-01-27 21:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8c3d4e-bad4-5388-a06d-020af83dad1d with scrape type 2
2026-01-27 21:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de8c3d4e-bad4-5388-a06d-020af83dad1d with scrape type 2
2026-01-27 21:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de8c3d4e-bad4-5388-a06d-020af83dad1d, identifier: SX45481
2026-01-27 21:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9a7d682-c8ea-5a08-b3df-c525bad44783 with identifier: DZ26704
2026-01-27 21:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9a7d682-c8ea-5a08-b3df-c525bad44783 with identifier: DZ26704
2026-01-27 21:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151909 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151909
2026-01-27 21:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b9a7d682-c8ea-5a08-b3df-c525bad44783 spider: auto1.it
2026-01-27 21:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: b9a7d682-c8ea-5a08-b3df-c525bad44783 due to rule: high_mileage_for_country.json, error: 151909 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151909
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:39:30Z',
'fuel_type': 'diesel',
'id': 'b9a7d682-c8ea-5a08-b3df-c525bad44783',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ26704',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 151909,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
'transmission': 'automatic',
'trim': 'Q4 Business',
'year': 2019}
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ26704%27 HTTP/1.1" 200 None
2026-01-27 21:00:56 [auto1.it] INFO: Saving data for DZ26704: {'auction_closing_time': 1769618370.0, 'created_time': 1768991785.914375, 'last_price_update_time': 1769547656.014399}
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DZ26704') HTTP/1.1" 204 0
2026-01-27 21:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de8c3d4e-bad4-5388-a06d-020af83dad1d with identifier: SX45481
2026-01-27 21:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de8c3d4e-bad4-5388-a06d-020af83dad1d with identifier: SX45481
2026-01-27 21:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de8c3d4e-bad4-5388-a06d-020af83dad1d with identifier: SX45481 to the API
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX45481>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-01-28T16:09:31Z',
'fuel_type': 'diesel',
'id': 'de8c3d4e-bad4-5388-a06d-020af83dad1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX45481',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 127200,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi Business Line',
'transmission': 'manual',
'trim': 'Business Line',
'year': 2019}
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX45481%27 HTTP/1.1" 200 None
2026-01-27 21:00:56 [auto1.it] INFO: Saving data for SX45481: {'auction_closing_time': 1769616571.0, 'created_time': 1768680159.657159, 'last_price_update_time': 1769547656.31149}
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX45481') HTTP/1.1" 204 0
2026-01-27 21:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA91703> (referer: https://www.auto1.com/v1/car-details-view/DA91703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH29835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e28d7b9d-e9e1-54e3-baad-c7541b6c528f with identifier: DA91703
2026-01-27 21:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e28d7b9d-e9e1-54e3-baad-c7541b6c528f with scrape type 2
2026-01-27 21:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e28d7b9d-e9e1-54e3-baad-c7541b6c528f with scrape type 2
2026-01-27 21:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e28d7b9d-e9e1-54e3-baad-c7541b6c528f, identifier: DA91703
2026-01-27 21:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e28d7b9d-e9e1-54e3-baad-c7541b6c528f with identifier: DA91703
2026-01-27 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e28d7b9d-e9e1-54e3-baad-c7541b6c528f with identifier: DA91703
2026-01-27 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158610 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158610
2026-01-27 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e28d7b9d-e9e1-54e3-baad-c7541b6c528f spider: auto1.it
2026-01-27 21:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e28d7b9d-e9e1-54e3-baad-c7541b6c528f due to rule: high_mileage_for_country.json, error: 158610 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158610
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:01:46Z',
'fuel_type': 'diesel',
'id': 'e28d7b9d-e9e1-54e3-baad-c7541b6c528f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA91703',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Peugeot',
'model': '3008',
'odometer': 158610,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2018}
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA91703%27 HTTP/1.1" 200 None
2026-01-27 21:00:57 [auto1.it] INFO: Saving data for DA91703: {'auction_closing_time': 1769616106.0, 'created_time': 1769458471.71783, 'last_price_update_time': 1769547657.242738}
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA91703') HTTP/1.1" 204 0
2026-01-27 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB20175> (referer: https://www.auto1.com/v1/car-details-view/SB20175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL92988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD40988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF33407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW71256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH86928/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf118e3-ab31-575a-9d1b-2c373d0029eb with identifier: SB20175
2026-01-27 21:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf118e3-ab31-575a-9d1b-2c373d0029eb with scrape type 2
2026-01-27 21:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf118e3-ab31-575a-9d1b-2c373d0029eb with scrape type 2
2026-01-27 21:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbf118e3-ab31-575a-9d1b-2c373d0029eb, identifier: SB20175
2026-01-27 21:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbf118e3-ab31-575a-9d1b-2c373d0029eb with identifier: SB20175
2026-01-27 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbf118e3-ab31-575a-9d1b-2c373d0029eb with identifier: SB20175
2026-01-27 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153263 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153263
2026-01-27 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bbf118e3-ab31-575a-9d1b-2c373d0029eb spider: auto1.it
2026-01-27 21:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bbf118e3-ab31-575a-9d1b-2c373d0029eb due to rule: high_mileage_for_country.json, error: 153263 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153263
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:34:40Z',
'fuel_type': 'hybrid',
'id': 'bbf118e3-ab31-575a-9d1b-2c373d0029eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB20175',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 153263,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 VC-T e-POWER Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2022}
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB20175%27 HTTP/1.1" 200 None
2026-01-27 21:00:57 [auto1.it] INFO: Saving data for SB20175: {'auction_closing_time': 1769618080.0, 'created_time': 1769458331.928094, 'last_price_update_time': 1769547657.689639}
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB20175') HTTP/1.1" 204 0
2026-01-27 21:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:58 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: WW18844
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW18844%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for WW18844: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: UU67161
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU67161%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for UU67161: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: WU99342
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU99342%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for WU99342: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: NU65526
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU65526%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for NU65526: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: LR66661
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66661%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for LR66661: 0
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: ZS49821
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS49821%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for ZS49821: 0
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: DP28978
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP28978%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for DP28978: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: VB04552
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for VB04552: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: ZE08740
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE08740%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for ZE08740: 0
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: DM01874
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM01874%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for DM01874: 0
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: VG35623
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG35623%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for VG35623: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: TY85783
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY85783%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for TY85783: 2
2026-01-27 21:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN61580> (referer: https://www.auto1.com/v1/car-details-view/DN61580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ43068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR19391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: WM98740
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM98740%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for WM98740: 2
2026-01-27 21:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK29975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: TD32917
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD32917%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for TD32917: 2
2026-01-27 21:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: HU59594
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU59594%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for HU59594: 2
2026-01-27 21:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM87024> (referer: https://www.auto1.com/v1/car-details-view/PM87024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: XS62284
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS62284%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for XS62284: 2
2026-01-27 21:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD70855> (referer: https://www.auto1.com/v1/car-details-view/XD70855/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: EY77758
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY77758%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for EY77758: 2
2026-01-27 21:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: WG74609
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG74609%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for WG74609: 0
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: CU67286
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU67286%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for CU67286: 2
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: LB68878
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB68878%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for LB68878: 2
2026-01-27 21:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a83a2c-14c2-580d-aabf-ec40734cced8 with identifier: DN61580
2026-01-27 21:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a83a2c-14c2-580d-aabf-ec40734cced8 with scrape type 2
2026-01-27 21:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a83a2c-14c2-580d-aabf-ec40734cced8 with scrape type 2
2026-01-27 21:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82a83a2c-14c2-580d-aabf-ec40734cced8, identifier: DN61580
2026-01-27 21:00:58 [auto1.it] INFO: Found listing with ID: DG99374
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG99374%27 HTTP/1.1" 200 None
2026-01-27 21:00:58 [auto1.it] INFO: Scrape type for DG99374: 2
2026-01-27 21:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82a83a2c-14c2-580d-aabf-ec40734cced8 with identifier: DN61580
2026-01-27 21:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82a83a2c-14c2-580d-aabf-ec40734cced8 with identifier: DN61580
2026-01-27 21:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82a83a2c-14c2-580d-aabf-ec40734cced8 with identifier: DN61580 to the API
2026-01-27 21:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN61580>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:15:59Z',
'fuel_type': 'diesel',
'id': '82a83a2c-14c2-580d-aabf-ec40734cced8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN61580',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Volvo',
'model': 'XC40',
'odometer': 104231,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 2.0 D3 R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2020}
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN61580%27 HTTP/1.1" 200 None
2026-01-27 21:00:59 [auto1.it] INFO: Saving data for DN61580: {'auction_closing_time': 1769616959.0, 'created_time': 1769248872.059825, 'last_price_update_time': 1769547659.143365}
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DN61580') HTTP/1.1" 204 0
2026-01-27 21:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN49537> (referer: https://www.auto1.com/v1/car-details-view/WN49537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024
2026-01-27 21:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23a15058-e35d-59fc-9ca8-f67ce867bd26 with scrape type 2
2026-01-27 21:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23a15058-e35d-59fc-9ca8-f67ce867bd26 with scrape type 2
2026-01-27 21:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23a15058-e35d-59fc-9ca8-f67ce867bd26, identifier: PM87024
2026-01-27 21:00:59 [auto1.it] INFO: Found listing with ID: BJ35088
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ35088%27 HTTP/1.1" 200 None
2026-01-27 21:00:59 [auto1.it] INFO: Scrape type for BJ35088: 0
2026-01-27 21:00:59 [auto1.it] INFO: Found listing with ID: NL52745
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL52745%27 HTTP/1.1" 200 None
2026-01-27 21:00:59 [auto1.it] INFO: Scrape type for NL52745: 2
2026-01-27 21:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024
2026-01-27 21:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024
2026-01-27 21:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23a15058-e35d-59fc-9ca8-f67ce867bd26 with identifier: PM87024 to the API
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM87024>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:37:25Z',
'fuel_type': 'diesel',
'id': '23a15058-e35d-59fc-9ca8-f67ce867bd26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM87024',
'listing': 'auction',
'location': 'IT, Livorno',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 82152,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM87024%27 HTTP/1.1" 200 None
2026-01-27 21:00:59 [auto1.it] INFO: Saving data for PM87024: {'auction_closing_time': 1769618245.0, 'created_time': 1769458444.255674, 'last_price_update_time': 1769547659.86523}
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM87024') HTTP/1.1" 204 0
2026-01-27 21:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC16084> (referer: https://www.auto1.com/v1/car-details-view/SC16084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-01-27 21:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f14374-b656-5692-abe7-824b6ba4a5ca with scrape type 2
2026-01-27 21:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f14374-b656-5692-abe7-824b6ba4a5ca with scrape type 2
2026-01-27 21:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97f14374-b656-5692-abe7-824b6ba4a5ca, identifier: XD70855
2026-01-27 21:00:59 [auto1.it] INFO: Found listing with ID: UF85865
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF85865%27 HTTP/1.1" 200 None
2026-01-27 21:01:00 [auto1.it] INFO: Scrape type for UF85865: 0
2026-01-27 21:01:00 [auto1.it] INFO: Found listing with ID: EU86944
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU86944%27 HTTP/1.1" 200 None
2026-01-27 21:01:00 [auto1.it] INFO: Scrape type for EU86944: 0
2026-01-27 21:01:00 [auto1.it] INFO: Found listing with ID: TR30387
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR30387%27 HTTP/1.1" 200 None
2026-01-27 21:01:00 [auto1.it] INFO: Scrape type for TR30387: 2
2026-01-27 21:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-01-27 21:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-01-27 21:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855 to the API
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD70855>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 194,
'expiration_date': '2026-01-28T16:25:04Z',
'fuel_type': 'diesel',
'id': '97f14374-b656-5692-abe7-824b6ba4a5ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD70855',
'listing': 'auction',
'location': 'IT, Frosinone',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 113075,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-19',
'seats_number': 4,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Premium Plus',
'transmission': 'automatic',
'trim': '4Matic Premium Plus',
'year': 2022}
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-01-27 21:01:00 [auto1.it] INFO: Saving data for XD70855: {'auction_closing_time': 1769617504.0, 'created_time': 1769458248.179902, 'last_price_update_time': 1769547660.380532}
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XD70855') HTTP/1.1" 204 0
2026-01-27 21:01:00 [auto1.it] INFO: Found listing with ID: EW00290
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW00290%27 HTTP/1.1" 200 None
2026-01-27 21:01:00 [auto1.it] INFO: Scrape type for EW00290: 2
2026-01-27 21:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e85fd56-e6d4-52ef-adea-b9f7612bec10 with identifier: WN49537
2026-01-27 21:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e85fd56-e6d4-52ef-adea-b9f7612bec10 with scrape type 2
2026-01-27 21:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e85fd56-e6d4-52ef-adea-b9f7612bec10 with scrape type 2
2026-01-27 21:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e85fd56-e6d4-52ef-adea-b9f7612bec10, identifier: WN49537
2026-01-27 21:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9fb30ab-b72e-5def-b103-c7bac8da4a57 with identifier: SC16084
2026-01-27 21:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9fb30ab-b72e-5def-b103-c7bac8da4a57 with scrape type 2
2026-01-27 21:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9fb30ab-b72e-5def-b103-c7bac8da4a57 with scrape type 2
2026-01-27 21:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9fb30ab-b72e-5def-b103-c7bac8da4a57, identifier: SC16084
2026-01-27 21:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE37664> (referer: https://www.auto1.com/v1/car-details-view/YE37664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e85fd56-e6d4-52ef-adea-b9f7612bec10 with identifier: WN49537
2026-01-27 21:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e85fd56-e6d4-52ef-adea-b9f7612bec10 with identifier: WN49537
2026-01-27 21:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e85fd56-e6d4-52ef-adea-b9f7612bec10 with identifier: WN49537 to the API
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WN49537>
{'auction_title': '',
'c_o_2_emission_value': 193,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 211,
'expiration_date': '2026-01-28T16:12:06Z',
'fuel_type': 'petrol',
'id': '3e85fd56-e6d4-52ef-adea-b9f7612bec10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN49537',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 91463,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2021}
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN49537%27 HTTP/1.1" 200 None
2026-01-27 21:01:00 [auto1.it] INFO: Saving data for WN49537: {'auction_closing_time': 1769616726.0, 'created_time': 1769025813.612422, 'last_price_update_time': 1769547660.891032}
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN49537') HTTP/1.1" 204 0
2026-01-27 21:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9fb30ab-b72e-5def-b103-c7bac8da4a57 with identifier: SC16084
2026-01-27 21:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9fb30ab-b72e-5def-b103-c7bac8da4a57 with identifier: SC16084
2026-01-27 21:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9fb30ab-b72e-5def-b103-c7bac8da4a57 with identifier: SC16084 to the API
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC16084>
{'auction_title': '',
'c_o_2_emission_value': 34,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 158,
'expiration_date': '2026-01-28T16:05:19Z',
'fuel_type': 'hybrid',
'id': 'a9fb30ab-b72e-5def-b103-c7bac8da4a57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC16084',
'listing': 'auction',
'location': 'IT, Pradamano (UD)',
'make': 'Renault',
'model': 'Captur',
'odometer': 60838,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.6 E-Tech Hybrid Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2021}
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC16084%27 HTTP/1.1" 200 None
2026-01-27 21:01:01 [auto1.it] INFO: Saving data for SC16084: {'auction_closing_time': 1769616319.0, 'created_time': 1769458392.153056, 'last_price_update_time': 1769547661.196712}
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC16084') HTTP/1.1" 204 0
2026-01-27 21:01:01 [auto1.it] INFO: Found listing with ID: GM65360
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM65360%27 HTTP/1.1" 200 None
2026-01-27 21:01:01 [auto1.it] INFO: Scrape type for GM65360: 2
2026-01-27 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:01 [auto1.it] INFO: Found listing with ID: ML60826
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML60826%27 HTTP/1.1" 200 None
2026-01-27 21:01:01 [auto1.it] INFO: Scrape type for ML60826: 2
2026-01-27 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL58155> (referer: https://www.auto1.com/v1/car-details-view/TL58155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA56454> (referer: https://www.auto1.com/v1/car-details-view/HA56454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN59549> (referer: https://www.auto1.com/v1/car-details-view/ZN59549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR47536> (referer: https://www.auto1.com/v1/car-details-view/ZR47536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH29835> (referer: https://www.auto1.com/v1/car-details-view/WH29835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b61b9e49-f209-570b-8372-228965f6a52a with identifier: YE37664
2026-01-27 21:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b61b9e49-f209-570b-8372-228965f6a52a with scrape type 2
2026-01-27 21:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b61b9e49-f209-570b-8372-228965f6a52a with scrape type 2
2026-01-27 21:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b61b9e49-f209-570b-8372-228965f6a52a, identifier: YE37664
2026-01-27 21:01:01 [auto1.it] INFO: Found listing with ID: HS43886
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS43886%27 HTTP/1.1" 200 None
2026-01-27 21:01:01 [auto1.it] INFO: Scrape type for HS43886: 0
2026-01-27 21:01:01 [auto1.it] INFO: Found listing with ID: CZ27491
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ27491%27 HTTP/1.1" 200 None
2026-01-27 21:01:01 [auto1.it] INFO: Scrape type for CZ27491: 2
2026-01-27 21:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b61b9e49-f209-570b-8372-228965f6a52a with identifier: YE37664
2026-01-27 21:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b61b9e49-f209-570b-8372-228965f6a52a with identifier: YE37664
2026-01-27 21:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b61b9e49-f209-570b-8372-228965f6a52a with identifier: YE37664 to the API
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE37664>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:10:35Z',
'fuel_type': 'diesel',
'id': 'b61b9e49-f209-570b-8372-228965f6a52a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE37664',
'listing': 'auction',
'location': 'IT, Voghera',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 128451,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Business BlueMotion',
'transmission': 'manual',
'trim': 'Business BlueMotion',
'year': 2018}
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE37664%27 HTTP/1.1" 200 None
2026-01-27 21:01:01 [auto1.it] INFO: Saving data for YE37664: {'auction_closing_time': 1769616635.0, 'created_time': 1769457659.142745, 'last_price_update_time': 1769547661.703532}
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE37664') HTTP/1.1" 204 0
2026-01-27 21:01:01 [auto1.it] INFO: Found listing with ID: XC50328
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50328%27 HTTP/1.1" 200 None
2026-01-27 21:01:01 [auto1.it] INFO: Scrape type for XC50328: 2
2026-01-27 21:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41a3236-9234-5366-a616-1a624aab9cf6 with identifier: TL58155
2026-01-27 21:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41a3236-9234-5366-a616-1a624aab9cf6 with scrape type 2
2026-01-27 21:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41a3236-9234-5366-a616-1a624aab9cf6 with scrape type 2
2026-01-27 21:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a41a3236-9234-5366-a616-1a624aab9cf6, identifier: TL58155
2026-01-27 21:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34235cbf-c54a-500b-b153-e6332f7ef382 with identifier: HA56454
2026-01-27 21:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34235cbf-c54a-500b-b153-e6332f7ef382 with scrape type 2
2026-01-27 21:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34235cbf-c54a-500b-b153-e6332f7ef382 with scrape type 2
2026-01-27 21:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34235cbf-c54a-500b-b153-e6332f7ef382, identifier: HA56454
2026-01-27 21:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549
2026-01-27 21:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with scrape type 2
2026-01-27 21:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with scrape type 2
2026-01-27 21:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f, identifier: ZN59549
2026-01-27 21:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6548361-a56f-5929-b679-cef42e9bd448 with identifier: ZR47536
2026-01-27 21:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6548361-a56f-5929-b679-cef42e9bd448 with scrape type 2
2026-01-27 21:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6548361-a56f-5929-b679-cef42e9bd448 with scrape type 2
2026-01-27 21:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f6548361-a56f-5929-b679-cef42e9bd448, identifier: ZR47536
2026-01-27 21:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a8e5d8-55d3-5aa5-be98-50619227c714 with identifier: WH29835
2026-01-27 21:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a8e5d8-55d3-5aa5-be98-50619227c714 with scrape type 2
2026-01-27 21:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9a8e5d8-55d3-5aa5-be98-50619227c714 with scrape type 2
2026-01-27 21:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c9a8e5d8-55d3-5aa5-be98-50619227c714, identifier: WH29835
2026-01-27 21:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a41a3236-9234-5366-a616-1a624aab9cf6 with identifier: TL58155
2026-01-27 21:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a41a3236-9234-5366-a616-1a624aab9cf6 with identifier: TL58155
2026-01-27 21:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145374 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
145374
2026-01-27 21:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a41a3236-9234-5366-a616-1a624aab9cf6 spider: auto1.it
2026-01-27 21:01:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a41a3236-9234-5366-a616-1a624aab9cf6 due to rule: high_mileage_for_make.json, error: 145374 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
145374
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2026-01-28T16:01:34Z',
'fuel_type': 'diesel',
'id': 'a41a3236-9234-5366-a616-1a624aab9cf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL58155',
'listing': 'auction',
'location': 'IT',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 145374,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
'transmission': 'automatic',
'trim': 'Q4 Lusso',
'year': 2019}
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL58155%27 HTTP/1.1" 200 None
2026-01-27 21:01:02 [auto1.it] INFO: Saving data for TL58155: {'auction_closing_time': 1769616094.0, 'created_time': 1769025969.886508, 'last_price_update_time': 1769547662.43382}
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL58155') HTTP/1.1" 204 0
2026-01-27 21:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34235cbf-c54a-500b-b153-e6332f7ef382 with identifier: HA56454
2026-01-27 21:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34235cbf-c54a-500b-b153-e6332f7ef382 with identifier: HA56454
2026-01-27 21:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34235cbf-c54a-500b-b153-e6332f7ef382 with identifier: HA56454 to the API
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA56454>
{'auction_title': '',
'c_o_2_emission_value': 42,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.4L',
'engine_horse_power': 245,
'expiration_date': '2026-01-28T16:21:11Z',
'fuel_type': 'hybrid',
'id': '34235cbf-c54a-500b-b153-e6332f7ef382',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA56454',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 75011,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2021}
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA56454%27 HTTP/1.1" 200 None
2026-01-27 21:01:02 [auto1.it] INFO: Saving data for HA56454: {'auction_closing_time': 1769617271.0, 'created_time': 1767816686.171874, 'last_price_update_time': 1769547662.89581}
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HA56454') HTTP/1.1" 204 0
2026-01-27 21:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549
2026-01-27 21:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549
2026-01-27 21:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f with identifier: ZN59549 to the API
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN59549>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 230,
'expiration_date': '2026-01-28T16:57:08Z',
'fuel_type': 'hybrid',
'id': '7fe7ad9e-0fb3-5adb-a6ca-bf4725474a0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN59549',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 54498,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
'transmission': 'automatic',
'trim': 'XLine 2WD',
'year': 2023}
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN59549%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Saving data for ZN59549: {'auction_closing_time': 1769619428.0, 'created_time': 1768594112.024027, 'last_price_update_time': 1769547663.233441}
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZN59549') HTTP/1.1" 204 0
2026-01-27 21:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f6548361-a56f-5929-b679-cef42e9bd448 with identifier: ZR47536
2026-01-27 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f6548361-a56f-5929-b679-cef42e9bd448 with identifier: ZR47536
2026-01-27 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-27 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f6548361-a56f-5929-b679-cef42e9bd448 spider: auto1.it
2026-01-27 21:01:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f6548361-a56f-5929-b679-cef42e9bd448 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-01-28T16:58:41Z',
'fuel_type': 'petrol',
'id': 'f6548361-a56f-5929-b679-cef42e9bd448',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR47536',
'listing': 'auction',
'location': 'Roma RM',
'make': 'Fiat',
'model': 'Panda',
'odometer': 7613,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-04-17',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR47536%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Saving data for ZR47536: {'auction_closing_time': 1769619521.0, 'created_time': 1769458540.824119, 'last_price_update_time': 1769547663.475911}
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR47536') HTTP/1.1" 204 0
2026-01-27 21:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c9a8e5d8-55d3-5aa5-be98-50619227c714 with identifier: WH29835
2026-01-27 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c9a8e5d8-55d3-5aa5-be98-50619227c714 with identifier: WH29835
2026-01-27 21:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c9a8e5d8-55d3-5aa5-be98-50619227c714 with identifier: WH29835 to the API
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WH29835>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:38:35Z',
'fuel_type': 'gas',
'id': 'c9a8e5d8-55d3-5aa5-be98-50619227c714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH29835',
'listing': 'auction',
'location': 'IT, Vigevano',
'make': 'Dacia',
'model': 'Duster',
'odometer': 63319,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Journey Up',
'transmission': 'manual',
'trim': 'Journey Up',
'year': 2023}
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH29835%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Saving data for WH29835: {'auction_closing_time': 1769618315.0, 'created_time': 1769458530.213115, 'last_price_update_time': 1769547663.803056}
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH29835') HTTP/1.1" 204 0
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: JC26558
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC26558%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for JC26558: 2
2026-01-27 21:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX21945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: EH49514
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH49514%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for EH49514: 2
2026-01-27 21:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: LY98983
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY98983%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for LY98983: 2
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: BJ54978
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ54978%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for BJ54978: 2
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: MK54572
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK54572%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for MK54572: 2
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: YY40771
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY40771%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for YY40771: 0
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: BT06439
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT06439%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for BT06439: 2
2026-01-27 21:01:03 [auto1.it] INFO: Found listing with ID: WA71595
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA71595%27 HTTP/1.1" 200 None
2026-01-27 21:01:03 [auto1.it] INFO: Scrape type for WA71595: 0
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY85783/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB04552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM98740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG35623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU59594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS62284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH86928> (referer: https://www.auto1.com/v1/car-details-view/YH86928/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64767829-e43c-5157-94a1-a5b4b2031710 with identifier: YH86928
2026-01-27 21:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64767829-e43c-5157-94a1-a5b4b2031710 with scrape type 2
2026-01-27 21:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64767829-e43c-5157-94a1-a5b4b2031710 with scrape type 2
2026-01-27 21:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64767829-e43c-5157-94a1-a5b4b2031710, identifier: YH86928
2026-01-27 21:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64767829-e43c-5157-94a1-a5b4b2031710 with identifier: YH86928
2026-01-27 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64767829-e43c-5157-94a1-a5b4b2031710 with identifier: YH86928
2026-01-27 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169835 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169835
2026-01-27 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 64767829-e43c-5157-94a1-a5b4b2031710 spider: auto1.it
2026-01-27 21:01:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 64767829-e43c-5157-94a1-a5b4b2031710 due to rule: high_mileage_for_country.json, error: 169835 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169835
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:40:08Z',
'fuel_type': 'diesel',
'id': '64767829-e43c-5157-94a1-a5b4b2031710',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH86928',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Audi',
'model': 'A6',
'odometer': 169835,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-01-27 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH86928%27 HTTP/1.1" 200 None
2026-01-27 21:01:04 [auto1.it] INFO: Saving data for YH86928: {'auction_closing_time': 1769618408.0, 'created_time': 1769457856.903874, 'last_price_update_time': 1769547664.969462}
2026-01-27 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH86928') HTTP/1.1" 204 0
2026-01-27 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG99374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL52745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW00290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR30387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM65360/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR19391> (referer: https://www.auto1.com/v1/car-details-view/RR19391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK29975> (referer: https://www.auto1.com/v1/car-details-view/FK29975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf22c9b-14db-5ed8-9266-d16b3d2d7070 with identifier: RR19391
2026-01-27 21:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf22c9b-14db-5ed8-9266-d16b3d2d7070 with scrape type 2
2026-01-27 21:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccf22c9b-14db-5ed8-9266-d16b3d2d7070 with scrape type 2
2026-01-27 21:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ccf22c9b-14db-5ed8-9266-d16b3d2d7070, identifier: RR19391
2026-01-27 21:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ccf22c9b-14db-5ed8-9266-d16b3d2d7070 with identifier: RR19391
2026-01-27 21:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ccf22c9b-14db-5ed8-9266-d16b3d2d7070 with identifier: RR19391
2026-01-27 21:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ccf22c9b-14db-5ed8-9266-d16b3d2d7070 with identifier: RR19391 to the API
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RR19391>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:15:26Z',
'fuel_type': 'diesel',
'id': 'ccf22c9b-14db-5ed8-9266-d16b3d2d7070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR19391',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 69577,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2019}
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR19391%27 HTTP/1.1" 200 None
2026-01-27 21:01:06 [auto1.it] INFO: Saving data for RR19391: {'auction_closing_time': 1769616926.0, 'created_time': 1769458544.706894, 'last_price_update_time': 1769547666.229672}
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RR19391') HTTP/1.1" 204 0
2026-01-27 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ43068> (referer: https://www.auto1.com/v1/car-details-view/GZ43068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC26558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX21945> (referer: https://www.auto1.com/v1/car-details-view/ZX21945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT06439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975
2026-01-27 21:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 780cb0b2-c560-5613-909e-67107024ab36 with scrape type 2
2026-01-27 21:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 780cb0b2-c560-5613-909e-67107024ab36 with scrape type 2
2026-01-27 21:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 780cb0b2-c560-5613-909e-67107024ab36, identifier: FK29975
2026-01-27 21:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975
2026-01-27 21:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975
2026-01-27 21:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 780cb0b2-c560-5613-909e-67107024ab36 with identifier: FK29975 to the API
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FK29975>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-01-28T16:32:35Z',
'fuel_type': 'petrol',
'id': '780cb0b2-c560-5613-909e-67107024ab36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK29975',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Jeep',
'model': 'Compass',
'odometer': 134601,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Longitude FWD',
'transmission': 'manual',
'trim': 'Longitude FWD',
'year': 2019}
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK29975%27 HTTP/1.1" 200 None
2026-01-27 21:01:06 [auto1.it] INFO: Saving data for FK29975: {'auction_closing_time': 1769617955.0, 'created_time': 1768593677.701927, 'last_price_update_time': 1769547666.653352}
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK29975') HTTP/1.1" 204 0
2026-01-27 21:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 with identifier: GZ43068
2026-01-27 21:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e06b709-0901-5d98-b929-eb3d054ad2b9 with scrape type 2
2026-01-27 21:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e06b709-0901-5d98-b929-eb3d054ad2b9 with scrape type 2
2026-01-27 21:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e06b709-0901-5d98-b929-eb3d054ad2b9, identifier: GZ43068
2026-01-27 21:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c9bbe3c-c79a-5f8b-baca-2febbcfb9606 with identifier: ZX21945
2026-01-27 21:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c9bbe3c-c79a-5f8b-baca-2febbcfb9606 with scrape type 2
2026-01-27 21:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c9bbe3c-c79a-5f8b-baca-2febbcfb9606 with scrape type 2
2026-01-27 21:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c9bbe3c-c79a-5f8b-baca-2febbcfb9606, identifier: ZX21945
2026-01-27 21:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 with identifier: GZ43068
2026-01-27 21:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 with identifier: GZ43068
2026-01-27 21:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181206 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
181206
2026-01-27 21:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 spider: auto1.it
2026-01-27 21:01:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3e06b709-0901-5d98-b929-eb3d054ad2b9 due to rule: high_mileage_for_country.json, error: 181206 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
181206
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': 'Taxi',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:15:22Z',
'fuel_type': 'diesel',
'id': '3e06b709-0901-5d98-b929-eb3d054ad2b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ43068',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 181206,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
'transmission': 'automatic',
'trim': 'Feel',
'year': 2019}
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ43068%27 HTTP/1.1" 200 None
2026-01-27 21:01:07 [auto1.it] INFO: Saving data for GZ43068: {'auction_closing_time': 1769616922.0, 'created_time': 1769458226.867196, 'last_price_update_time': 1769547667.082639}
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ43068') HTTP/1.1" 204 0
2026-01-27 21:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c9bbe3c-c79a-5f8b-baca-2febbcfb9606 with identifier: ZX21945
2026-01-27 21:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c9bbe3c-c79a-5f8b-baca-2febbcfb9606 with identifier: ZX21945
2026-01-27 21:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c9bbe3c-c79a-5f8b-baca-2febbcfb9606 with identifier: ZX21945 to the API
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZX21945>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-28T16:19:03Z',
'fuel_type': 'petrol',
'id': '5c9bbe3c-c79a-5f8b-baca-2febbcfb9606',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX21945',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Ford',
'model': 'Puma',
'odometer': 71840,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line Design',
'transmission': 'manual',
'trim': 'ST-Line Design',
'year': 2022}
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX21945%27 HTTP/1.1" 200 None
2026-01-27 21:01:07 [auto1.it] INFO: Saving data for ZX21945: {'auction_closing_time': 1769617143.0, 'created_time': 1768248438.266924, 'last_price_update_time': 1769547667.446248}
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX21945') HTTP/1.1" 204 0
2026-01-27 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ54978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK54572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB04552> (referer: https://www.auto1.com/v1/car-details-view/VB04552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY85783> (referer: https://www.auto1.com/v1/car-details-view/TY85783/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552
2026-01-27 21:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65755d90-350c-5eed-811e-5c405af37e60 with scrape type 2
2026-01-27 21:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65755d90-350c-5eed-811e-5c405af37e60 with scrape type 2
2026-01-27 21:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65755d90-350c-5eed-811e-5c405af37e60, identifier: VB04552
2026-01-27 21:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41ae8f51-95b8-5b86-9138-2dd88a3e68c3 with identifier: TY85783
2026-01-27 21:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41ae8f51-95b8-5b86-9138-2dd88a3e68c3 with scrape type 2
2026-01-27 21:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41ae8f51-95b8-5b86-9138-2dd88a3e68c3 with scrape type 2
2026-01-27 21:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41ae8f51-95b8-5b86-9138-2dd88a3e68c3, identifier: TY85783
2026-01-27 21:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552
2026-01-27 21:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552
2026-01-27 21:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552 to the API
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VB04552>
{'auction_title': '',
'c_o_2_emission_value': 185,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 300,
'expiration_date': '2026-01-28T16:14:04Z',
'fuel_type': 'petrol',
'id': '65755d90-350c-5eed-811e-5c405af37e60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB04552',
'listing': 'auction',
'location': 'Milano',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 41260,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-05',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Velar 2.0 Si4 TwinTurbo',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-01-27 21:01:08 [auto1.it] INFO: Saving data for VB04552: {'auction_closing_time': 1769616844.0, 'created_time': 1769458457.602343, 'last_price_update_time': 1769547668.051923}
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB04552') HTTP/1.1" 204 0
2026-01-27 21:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41ae8f51-95b8-5b86-9138-2dd88a3e68c3 with identifier: TY85783
2026-01-27 21:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41ae8f51-95b8-5b86-9138-2dd88a3e68c3 with identifier: TY85783
2026-01-27 21:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41ae8f51-95b8-5b86-9138-2dd88a3e68c3 with identifier: TY85783 to the API
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY85783>
{'auction_title': '',
'c_o_2_emission_value': 195,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 280,
'expiration_date': '2026-01-28T16:14:21Z',
'fuel_type': 'petrol',
'id': '41ae8f51-95b8-5b86-9138-2dd88a3e68c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY85783',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 94705,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.0 Turbo Veloce Q4',
'transmission': 'automatic',
'trim': 'Veloce Q4',
'year': 2021}
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY85783%27 HTTP/1.1" 200 None
2026-01-27 21:01:08 [auto1.it] INFO: Saving data for TY85783: {'auction_closing_time': 1769616861.0, 'created_time': 1768507618.929724, 'last_price_update_time': 1769547668.381932}
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TY85783') HTTP/1.1" 204 0
2026-01-27 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY98983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU59594> (referer: https://www.auto1.com/v1/car-details-view/HU59594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS62284> (referer: https://www.auto1.com/v1/car-details-view/XS62284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG99374> (referer: https://www.auto1.com/v1/car-details-view/DG99374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922fab65-d50f-5875-b81a-c95850d30ddf with identifier: HU59594
2026-01-27 21:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922fab65-d50f-5875-b81a-c95850d30ddf with scrape type 2
2026-01-27 21:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 922fab65-d50f-5875-b81a-c95850d30ddf with scrape type 2
2026-01-27 21:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 922fab65-d50f-5875-b81a-c95850d30ddf, identifier: HU59594
2026-01-27 21:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 922fab65-d50f-5875-b81a-c95850d30ddf with identifier: HU59594
2026-01-27 21:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 922fab65-d50f-5875-b81a-c95850d30ddf with identifier: HU59594
2026-01-27 21:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131724 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
131724
2026-01-27 21:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 922fab65-d50f-5875-b81a-c95850d30ddf spider: auto1.it
2026-01-27 21:01:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 922fab65-d50f-5875-b81a-c95850d30ddf due to rule: high_mileage_for_make.json, error: 131724 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
131724
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:51:41Z',
'fuel_type': 'diesel',
'id': '922fab65-d50f-5875-b81a-c95850d30ddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU59594',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Peugeot',
'model': '2008',
'odometer': 131724,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU59594%27 HTTP/1.1" 200 None
2026-01-27 21:01:08 [auto1.it] INFO: Saving data for HU59594: {'auction_closing_time': 1769619101.0, 'created_time': 1769457946.923677, 'last_price_update_time': 1769547668.839954}
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU59594') HTTP/1.1" 204 0
2026-01-27 21:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55322dd2-2c7a-5a59-a50d-f5acb92a313c with identifier: XS62284
2026-01-27 21:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55322dd2-2c7a-5a59-a50d-f5acb92a313c with scrape type 2
2026-01-27 21:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55322dd2-2c7a-5a59-a50d-f5acb92a313c with scrape type 2
2026-01-27 21:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55322dd2-2c7a-5a59-a50d-f5acb92a313c, identifier: XS62284
2026-01-27 21:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e79700f-f4df-5334-b84e-6211c665bcd6 with identifier: DG99374
2026-01-27 21:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e79700f-f4df-5334-b84e-6211c665bcd6 with scrape type 2
2026-01-27 21:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e79700f-f4df-5334-b84e-6211c665bcd6 with scrape type 2
2026-01-27 21:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e79700f-f4df-5334-b84e-6211c665bcd6, identifier: DG99374
2026-01-27 21:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55322dd2-2c7a-5a59-a50d-f5acb92a313c with identifier: XS62284
2026-01-27 21:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55322dd2-2c7a-5a59-a50d-f5acb92a313c with identifier: XS62284
2026-01-27 21:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 55322dd2-2c7a-5a59-a50d-f5acb92a313c with identifier: XS62284 to the API
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS62284>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-01-28T16:04:09Z',
'fuel_type': 'diesel',
'id': '55322dd2-2c7a-5a59-a50d-f5acb92a313c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS62284',
'listing': 'auction',
'location': 'IT, Modena',
'make': 'Kia',
'model': 'Sportage',
'odometer': 39799,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS62284%27 HTTP/1.1" 200 None
2026-01-27 21:01:09 [auto1.it] INFO: Saving data for XS62284: {'auction_closing_time': 1769616249.0, 'created_time': 1769457663.336243, 'last_price_update_time': 1769547669.389746}
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XS62284') HTTP/1.1" 204 0
2026-01-27 21:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e79700f-f4df-5334-b84e-6211c665bcd6 with identifier: DG99374
2026-01-27 21:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e79700f-f4df-5334-b84e-6211c665bcd6 with identifier: DG99374
2026-01-27 21:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e79700f-f4df-5334-b84e-6211c665bcd6 with identifier: DG99374 to the API
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG99374>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:15:44Z',
'fuel_type': 'diesel',
'id': '6e79700f-f4df-5334-b84e-6211c665bcd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG99374',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Audi',
'model': 'Q3',
'odometer': 125076,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG99374%27 HTTP/1.1" 200 None
2026-01-27 21:01:09 [auto1.it] INFO: Saving data for DG99374: {'auction_closing_time': 1769616944.0, 'created_time': 1769025660.5721, 'last_price_update_time': 1769547669.72452}
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DG99374') HTTP/1.1" 204 0
2026-01-27 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW00290> (referer: https://www.auto1.com/v1/car-details-view/EW00290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG35623> (referer: https://www.auto1.com/v1/car-details-view/VG35623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM98740> (referer: https://www.auto1.com/v1/car-details-view/WM98740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL52745> (referer: https://www.auto1.com/v1/car-details-view/NL52745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c0ed380-c2c0-5652-b935-c7b9f6da1c7a with identifier: EW00290
2026-01-27 21:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0ed380-c2c0-5652-b935-c7b9f6da1c7a with scrape type 2
2026-01-27 21:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c0ed380-c2c0-5652-b935-c7b9f6da1c7a with scrape type 2
2026-01-27 21:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c0ed380-c2c0-5652-b935-c7b9f6da1c7a, identifier: EW00290
2026-01-27 21:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea2586ab-06e6-52a3-8e73-349dd8e70f2c with identifier: VG35623
2026-01-27 21:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea2586ab-06e6-52a3-8e73-349dd8e70f2c with scrape type 2
2026-01-27 21:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea2586ab-06e6-52a3-8e73-349dd8e70f2c with scrape type 2
2026-01-27 21:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea2586ab-06e6-52a3-8e73-349dd8e70f2c, identifier: VG35623
2026-01-27 21:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d2f5f6-12b4-5946-b8e8-c34f3288024c with identifier: WM98740
2026-01-27 21:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d2f5f6-12b4-5946-b8e8-c34f3288024c with scrape type 2
2026-01-27 21:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d2f5f6-12b4-5946-b8e8-c34f3288024c with scrape type 2
2026-01-27 21:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c4d2f5f6-12b4-5946-b8e8-c34f3288024c, identifier: WM98740
2026-01-27 21:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c0ed380-c2c0-5652-b935-c7b9f6da1c7a with identifier: EW00290
2026-01-27 21:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c0ed380-c2c0-5652-b935-c7b9f6da1c7a with identifier: EW00290
2026-01-27 21:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c0ed380-c2c0-5652-b935-c7b9f6da1c7a with identifier: EW00290 to the API
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW00290>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:19:29Z',
'fuel_type': 'diesel',
'id': '8c0ed380-c2c0-5652-b935-c7b9f6da1c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW00290',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Jeep',
'model': 'Compass',
'odometer': 121778,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2019}
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW00290%27 HTTP/1.1" 200 None
2026-01-27 21:01:10 [auto1.it] INFO: Saving data for EW00290: {'auction_closing_time': 1769617169.0, 'created_time': 1768464068.213896, 'last_price_update_time': 1769547670.437105}
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW00290') HTTP/1.1" 204 0
2026-01-27 21:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea2586ab-06e6-52a3-8e73-349dd8e70f2c with identifier: VG35623
2026-01-27 21:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea2586ab-06e6-52a3-8e73-349dd8e70f2c with identifier: VG35623
2026-01-27 21:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea2586ab-06e6-52a3-8e73-349dd8e70f2c with identifier: VG35623 to the API
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VG35623>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:18:17Z',
'fuel_type': 'diesel',
'id': 'ea2586ab-06e6-52a3-8e73-349dd8e70f2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG35623',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 73000,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG35623%27 HTTP/1.1" 200 None
2026-01-27 21:01:10 [auto1.it] INFO: Saving data for VG35623: {'auction_closing_time': 1769617097.0, 'created_time': 1769025941.779697, 'last_price_update_time': 1769547670.735891}
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VG35623') HTTP/1.1" 204 0
2026-01-27 21:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c4d2f5f6-12b4-5946-b8e8-c34f3288024c with identifier: WM98740
2026-01-27 21:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c4d2f5f6-12b4-5946-b8e8-c34f3288024c with identifier: WM98740
2026-01-27 21:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-27 21:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c4d2f5f6-12b4-5946-b8e8-c34f3288024c spider: auto1.it
2026-01-27 21:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c4d2f5f6-12b4-5946-b8e8-c34f3288024c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-01-28T16:25:21Z',
'fuel_type': 'petrol',
'id': 'c4d2f5f6-12b4-5946-b8e8-c34f3288024c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM98740',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Fiat',
'model': 'Panda',
'odometer': 6074,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM98740%27 HTTP/1.1" 200 None
2026-01-27 21:01:10 [auto1.it] INFO: Saving data for WM98740: {'auction_closing_time': 1769617521.0, 'created_time': 1768990244.752653, 'last_price_update_time': 1769547670.984102}
2026-01-27 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM98740') HTTP/1.1" 204 0
2026-01-27 21:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a83e85f2-dc8a-55d6-8a57-37ac823e0764 with identifier: NL52745
2026-01-27 21:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a83e85f2-dc8a-55d6-8a57-37ac823e0764 with scrape type 2
2026-01-27 21:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a83e85f2-dc8a-55d6-8a57-37ac823e0764 with scrape type 2
2026-01-27 21:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a83e85f2-dc8a-55d6-8a57-37ac823e0764, identifier: NL52745
2026-01-27 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC50328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR30387> (referer: https://www.auto1.com/v1/car-details-view/TR30387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH49514/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM65360> (referer: https://www.auto1.com/v1/car-details-view/GM65360/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a83e85f2-dc8a-55d6-8a57-37ac823e0764 with identifier: NL52745
2026-01-27 21:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a83e85f2-dc8a-55d6-8a57-37ac823e0764 with identifier: NL52745
2026-01-27 21:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a83e85f2-dc8a-55d6-8a57-37ac823e0764 with identifier: NL52745 to the API
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL52745>
{'auction_title': '',
'c_o_2_emission_value': 204,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 354,
'expiration_date': '2026-01-28T16:08:13Z',
'fuel_type': 'petrol',
'id': 'a83e85f2-dc8a-55d6-8a57-37ac823e0764',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL52745',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Porsche',
'model': 'Macan',
'odometer': 143162,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL52745%27 HTTP/1.1" 200 None
2026-01-27 21:01:11 [auto1.it] INFO: Saving data for NL52745: {'auction_closing_time': 1769616493.0, 'created_time': 1769026033.182541, 'last_price_update_time': 1769547671.42066}
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL52745') HTTP/1.1" 204 0
2026-01-27 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 719c4190-ff9b-543d-b071-09cbab4460a9 with identifier: TR30387
2026-01-27 21:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 719c4190-ff9b-543d-b071-09cbab4460a9 with scrape type 2
2026-01-27 21:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 719c4190-ff9b-543d-b071-09cbab4460a9 with scrape type 2
2026-01-27 21:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 719c4190-ff9b-543d-b071-09cbab4460a9, identifier: TR30387
2026-01-27 21:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5578b65-1bc0-513c-ba23-0856c9fd0356 with identifier: GM65360
2026-01-27 21:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5578b65-1bc0-513c-ba23-0856c9fd0356 with scrape type 2
2026-01-27 21:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5578b65-1bc0-513c-ba23-0856c9fd0356 with scrape type 2
2026-01-27 21:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5578b65-1bc0-513c-ba23-0856c9fd0356, identifier: GM65360
2026-01-27 21:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 719c4190-ff9b-543d-b071-09cbab4460a9 with identifier: TR30387
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-01-27 21:01:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 719c4190-ff9b-543d-b071-09cbab4460a9 with identifier: TR30387
2026-01-27 21:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 719c4190-ff9b-543d-b071-09cbab4460a9 with identifier: TR30387 to the API
2026-01-27 21:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR30387>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 181,
'expiration_date': '2026-01-28T16:46:04Z',
'fuel_type': 'petrol',
'id': '719c4190-ff9b-543d-b071-09cbab4460a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR30387',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 79232,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 PureTech Grand Chic',
'transmission': 'automatic',
'trim': 'Grand Chic',
'year': 2018}
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR30387%27 HTTP/1.1" 200 None
2026-01-27 21:01:12 [auto1.it] INFO: Saving data for TR30387: {'auction_closing_time': 1769618764.0, 'created_time': 1767643419.731617, 'last_price_update_time': 1769547672.158946}
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR30387') HTTP/1.1" 204 0
2026-01-27 21:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5578b65-1bc0-513c-ba23-0856c9fd0356 with identifier: GM65360
2026-01-27 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5578b65-1bc0-513c-ba23-0856c9fd0356 with identifier: GM65360
2026-01-27 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-27 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f5578b65-1bc0-513c-ba23-0856c9fd0356 spider: auto1.it
2026-01-27 21:01:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f5578b65-1bc0-513c-ba23-0856c9fd0356 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '0.9L',
'engine_horse_power': 85,
'expiration_date': '2026-01-28T16:46:07Z',
'fuel_type': 'petrol',
'id': 'f5578b65-1bc0-513c-ba23-0856c9fd0356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM65360',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Fiat',
'model': 'Panda',
'odometer': 75581,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-30',
'seats_number': 2,
'seller_name': None,
'title': 'Fiat Panda 0.9 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2021}
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM65360%27 HTTP/1.1" 200 None
2026-01-27 21:01:12 [auto1.it] INFO: Saving data for GM65360: {'auction_closing_time': 1769618767.0, 'created_time': 1769457948.551668, 'last_price_update_time': 1769547672.40067}
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM65360') HTTP/1.1" 204 0
2026-01-27 21:01:12 [scrapy.extensions.logstats] INFO: Crawled 182 pages (at 182 pages/min), scraped 61 items (at 61 items/min)
2026-01-27 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT06439> (referer: https://www.auto1.com/v1/car-details-view/BT06439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC26558> (referer: https://www.auto1.com/v1/car-details-view/JC26558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML60826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ27491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439
2026-01-27 21:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25de4bc9-6fda-595b-ac3e-725078b60151 with scrape type 2
2026-01-27 21:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25de4bc9-6fda-595b-ac3e-725078b60151 with scrape type 2
2026-01-27 21:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25de4bc9-6fda-595b-ac3e-725078b60151, identifier: BT06439
2026-01-27 21:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439
2026-01-27 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439
2026-01-27 21:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439 to the API
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT06439>
{'auction_title': '',
'c_o_2_emission_value': 171,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2026-01-28T16:59:32Z',
'fuel_type': 'diesel',
'id': '25de4bc9-6fda-595b-ac3e-725078b60151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT06439',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 100006,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-20',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic',
'transmission': 'automatic',
'trim': 'R-Dynamic',
'year': 2019}
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT06439%27 HTTP/1.1" 200 None
2026-01-27 21:01:12 [auto1.it] INFO: Saving data for BT06439: {'auction_closing_time': 1769619572.0, 'created_time': 1768991157.142206, 'last_price_update_time': 1769547672.966194}
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT06439') HTTP/1.1" 204 0
2026-01-27 21:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11402f26-b454-550c-9d11-d426599cdeaa with identifier: JC26558
2026-01-27 21:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11402f26-b454-550c-9d11-d426599cdeaa with scrape type 2
2026-01-27 21:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11402f26-b454-550c-9d11-d426599cdeaa with scrape type 2
2026-01-27 21:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 11402f26-b454-550c-9d11-d426599cdeaa, identifier: JC26558
2026-01-27 21:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 11402f26-b454-550c-9d11-d426599cdeaa with identifier: JC26558
2026-01-27 21:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 11402f26-b454-550c-9d11-d426599cdeaa with identifier: JC26558
2026-01-27 21:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 11402f26-b454-550c-9d11-d426599cdeaa with identifier: JC26558 to the API
2026-01-27 21:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC26558>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:55:59Z',
'fuel_type': 'petrol',
'id': '11402f26-b454-550c-9d11-d426599cdeaa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC26558',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 30393,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-10',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Summit',
'transmission': 'manual',
'trim': 'Summit',
'year': 2023}
2026-01-27 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC26558%27 HTTP/1.1" 200 None
2026-01-27 21:01:13 [auto1.it] INFO: Saving data for JC26558: {'auction_closing_time': 1769619359.0, 'created_time': 1769458368.664302, 'last_price_update_time': 1769547673.447772}
2026-01-27 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC26558') HTTP/1.1" 204 0
2026-01-27 21:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP28978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU67286/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ54978> (referer: https://www.auto1.com/v1/car-details-view/BJ54978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY77758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD32917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY98983> (referer: https://www.auto1.com/v1/car-details-view/LY98983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK54572> (referer: https://www.auto1.com/v1/car-details-view/MK54572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5002a5c9-3da2-549b-b0d6-c0d92e249d2f with identifier: BJ54978
2026-01-27 21:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5002a5c9-3da2-549b-b0d6-c0d92e249d2f with scrape type 2
2026-01-27 21:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5002a5c9-3da2-549b-b0d6-c0d92e249d2f with scrape type 2
2026-01-27 21:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5002a5c9-3da2-549b-b0d6-c0d92e249d2f, identifier: BJ54978
2026-01-27 21:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5002a5c9-3da2-549b-b0d6-c0d92e249d2f with identifier: BJ54978
2026-01-27 21:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5002a5c9-3da2-549b-b0d6-c0d92e249d2f with identifier: BJ54978
2026-01-27 21:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5002a5c9-3da2-549b-b0d6-c0d92e249d2f with identifier: BJ54978 to the API
2026-01-27 21:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ54978>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:07:55Z',
'fuel_type': 'petrol',
'id': '5002a5c9-3da2-549b-b0d6-c0d92e249d2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ54978',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 101749,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 1.0 TSI Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2019}
2026-01-27 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ54978%27 HTTP/1.1" 200 None
2026-01-27 21:01:14 [auto1.it] INFO: Saving data for BJ54978: {'auction_closing_time': 1769616475.0, 'created_time': 1769458224.004143, 'last_price_update_time': 1769547674.726752}
2026-01-27 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ54978') HTTP/1.1" 204 0
2026-01-27 21:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17a742f5-eda5-5d99-8468-de06d486730d with identifier: LY98983
2026-01-27 21:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17a742f5-eda5-5d99-8468-de06d486730d with scrape type 2
2026-01-27 21:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17a742f5-eda5-5d99-8468-de06d486730d with scrape type 2
2026-01-27 21:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17a742f5-eda5-5d99-8468-de06d486730d, identifier: LY98983
2026-01-27 21:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca88adf-c4ca-535f-aa1a-64450faee157 with identifier: MK54572
2026-01-27 21:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca88adf-c4ca-535f-aa1a-64450faee157 with scrape type 2
2026-01-27 21:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ca88adf-c4ca-535f-aa1a-64450faee157 with scrape type 2
2026-01-27 21:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ca88adf-c4ca-535f-aa1a-64450faee157, identifier: MK54572
2026-01-27 21:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17a742f5-eda5-5d99-8468-de06d486730d with identifier: LY98983
2026-01-27 21:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17a742f5-eda5-5d99-8468-de06d486730d with identifier: LY98983
2026-01-27 21:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-27 21:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 17a742f5-eda5-5d99-8468-de06d486730d spider: auto1.it
2026-01-27 21:01:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 17a742f5-eda5-5d99-8468-de06d486730d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
'c_o_2_emission_value': 192,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-01-28T16:46:48Z',
'fuel_type': 'diesel',
'id': '17a742f5-eda5-5d99-8468-de06d486730d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY98983',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 102892,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-28',
'seats_number': 6,
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Active',
'transmission': 'automatic',
'trim': '320 L1 Tourneo Active',
'year': 2021}
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY98983%27 HTTP/1.1" 200 None
2026-01-27 21:01:15 [auto1.it] INFO: Saving data for LY98983: {'auction_closing_time': 1769618808.0, 'created_time': 1768557727.105653, 'last_price_update_time': 1769547675.157703}
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY98983') HTTP/1.1" 204 0
2026-01-27 21:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ca88adf-c4ca-535f-aa1a-64450faee157 with identifier: MK54572
2026-01-27 21:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ca88adf-c4ca-535f-aa1a-64450faee157 with identifier: MK54572
2026-01-27 21:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ca88adf-c4ca-535f-aa1a-64450faee157 with identifier: MK54572 to the API
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MK54572>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2026-01-28T16:37:59Z',
'fuel_type': 'petrol',
'id': '9ca88adf-c4ca-535f-aa1a-64450faee157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK54572',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 45786,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2021}
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK54572%27 HTTP/1.1" 200 None
2026-01-27 21:01:15 [auto1.it] INFO: Saving data for MK54572: {'auction_closing_time': 1769618279.0, 'created_time': 1769457955.97482, 'last_price_update_time': 1769547675.469142}
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MK54572') HTTP/1.1" 204 0
2026-01-27 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU99342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU67161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW18844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU65526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH49514> (referer: https://www.auto1.com/v1/car-details-view/EH49514/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2 with identifier: EH49514
2026-01-27 21:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2 with scrape type 2
2026-01-27 21:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2 with scrape type 2
2026-01-27 21:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2, identifier: EH49514
2026-01-27 21:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2 with identifier: EH49514
2026-01-27 21:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2 with identifier: EH49514
2026-01-27 21:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2 with identifier: EH49514 to the API
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH49514>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 178,
'expiration_date': '2026-01-28T16:45:44Z',
'fuel_type': 'petrol',
'id': 'f9c3fb93-e6e8-5d27-80b6-7f6a2e6632a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH49514',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'make': 'MINI',
'model': 'Countryman',
'odometer': 30244,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper S ALL4 John Cooper Works Trim',
'transmission': 'automatic',
'trim': 'ALL4 John Cooper Works Trim',
'year': 2022}
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH49514%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Saving data for EH49514: {'auction_closing_time': 1769618744.0, 'created_time': 1768464048.22005, 'last_price_update_time': 1769547676.01675}
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH49514') HTTP/1.1" 204 0
2026-01-27 21:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC50328> (referer: https://www.auto1.com/v1/car-details-view/XC50328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:16 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: FT86640
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT86640%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for FT86640: 2
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: RN24419
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for RN24419: 2
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: VL59630
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL59630%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for VL59630: 2
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: SP36812
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP36812%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for SP36812: 2
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: AW96093
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW96093%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for AW96093: 2
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: DE55553
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE55553%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for DE55553: 2
2026-01-27 21:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328
2026-01-27 21:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec42b96-a07b-51b5-9cc9-40e0431f810c with scrape type 2
2026-01-27 21:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec42b96-a07b-51b5-9cc9-40e0431f810c with scrape type 2
2026-01-27 21:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ec42b96-a07b-51b5-9cc9-40e0431f810c, identifier: XC50328
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: NR38065
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR38065%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for NR38065: 2
2026-01-27 21:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328
2026-01-27 21:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328
2026-01-27 21:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328 to the API
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC50328>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:27:22Z',
'fuel_type': 'diesel',
'id': '6ec42b96-a07b-51b5-9cc9-40e0431f810c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC50328',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'BMW',
'model': '1er',
'odometer': 116005,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2020}
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50328%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Saving data for XC50328: {'auction_closing_time': 1769617642.0, 'created_time': 1768989752.693349, 'last_price_update_time': 1769547676.860385}
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC50328') HTTP/1.1" 204 0
2026-01-27 21:01:16 [auto1.it] INFO: Found listing with ID: FM42307
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM42307%27 HTTP/1.1" 200 None
2026-01-27 21:01:16 [auto1.it] INFO: Scrape type for FM42307: 2
2026-01-27 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ27491> (referer: https://www.auto1.com/v1/car-details-view/CZ27491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML60826> (referer: https://www.auto1.com/v1/car-details-view/ML60826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW71256> (referer: https://www.auto1.com/v1/car-details-view/KW71256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP28978> (referer: https://www.auto1.com/v1/car-details-view/DP28978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: VW59498
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW59498%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for VW59498: 2
2026-01-27 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: YC09499
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC09499%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for YC09499: 2
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: ZL05088
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL05088%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for ZL05088: 2
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: BG40682
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG40682%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for BG40682: 0
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: LX56399
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX56399%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for LX56399: 2
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: YK92644
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK92644%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for YK92644: 2
2026-01-27 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF33407> (referer: https://www.auto1.com/v1/car-details-view/EF33407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: WW83392
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83392%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for WW83392: 2
2026-01-27 21:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491
2026-01-27 21:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a3fb221-e8f6-5c19-8861-8f02e77e233e, identifier: CZ27491
2026-01-27 21:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826
2026-01-27 21:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b, identifier: ML60826
2026-01-27 21:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd1ac526-4314-53b3-9de4-6704799cfbe9 with identifier: KW71256
2026-01-27 21:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd1ac526-4314-53b3-9de4-6704799cfbe9 with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd1ac526-4314-53b3-9de4-6704799cfbe9 with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd1ac526-4314-53b3-9de4-6704799cfbe9, identifier: KW71256
2026-01-27 21:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a198e5-cb7a-5e24-a6e2-812de56febdc with identifier: DP28978
2026-01-27 21:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a198e5-cb7a-5e24-a6e2-812de56febdc with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a198e5-cb7a-5e24-a6e2-812de56febdc with scrape type 2
2026-01-27 21:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4a198e5-cb7a-5e24-a6e2-812de56febdc, identifier: DP28978
2026-01-27 21:01:17 [auto1.it] INFO: Found listing with ID: MU47975
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47975%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Scrape type for MU47975: 2
2026-01-27 21:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491
2026-01-27 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491
2026-01-27 21:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491 to the API
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ27491>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:41:40Z',
'fuel_type': 'petrol',
'id': '8a3fb221-e8f6-5c19-8861-8f02e77e233e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ27491',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 20524,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2024}
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ27491%27 HTTP/1.1" 200 None
2026-01-27 21:01:17 [auto1.it] INFO: Saving data for CZ27491: {'auction_closing_time': 1769618500.0, 'created_time': 1769458229.905643, 'last_price_update_time': 1769547677.830328}
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ27491') HTTP/1.1" 204 0
2026-01-27 21:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826
2026-01-27 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826
2026-01-27 21:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c395d78e-9399-5cc8-9cd2-e8ba507b6f0b with identifier: ML60826 to the API
2026-01-27 21:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML60826>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:24:46Z',
'fuel_type': 'diesel',
'id': 'c395d78e-9399-5cc8-9cd2-e8ba507b6f0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML60826',
'listing': 'auction',
'location': 'IT, Foggia',
'make': 'Ford',
'model': 'Kuga',
'odometer': 113014,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2020}
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML60826%27 HTTP/1.1" 200 None
2026-01-27 21:01:18 [auto1.it] INFO: Saving data for ML60826: {'auction_closing_time': 1769617486.0, 'created_time': 1769458463.47277, 'last_price_update_time': 1769547678.129262}
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML60826') HTTP/1.1" 204 0
2026-01-27 21:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd1ac526-4314-53b3-9de4-6704799cfbe9 with identifier: KW71256
2026-01-27 21:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd1ac526-4314-53b3-9de4-6704799cfbe9 with identifier: KW71256
2026-01-27 21:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd1ac526-4314-53b3-9de4-6704799cfbe9 with identifier: KW71256 to the API
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KW71256>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:06:41Z',
'fuel_type': 'petrol',
'id': 'dd1ac526-4314-53b3-9de4-6704799cfbe9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW71256',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 40134,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Longitude',
'transmission': 'manual',
'trim': 'Longitude',
'year': 2023}
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW71256%27 HTTP/1.1" 200 None
2026-01-27 21:01:18 [auto1.it] INFO: Saving data for KW71256: {'auction_closing_time': 1769616401.0, 'created_time': 1769457919.948934, 'last_price_update_time': 1769547678.428478}
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW71256') HTTP/1.1" 204 0
2026-01-27 21:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4a198e5-cb7a-5e24-a6e2-812de56febdc with identifier: DP28978
2026-01-27 21:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4a198e5-cb7a-5e24-a6e2-812de56febdc with identifier: DP28978
2026-01-27 21:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
2026-01-27 21:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a4a198e5-cb7a-5e24-a6e2-812de56febdc spider: auto1.it
2026-01-27 21:01:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a4a198e5-cb7a-5e24-a6e2-812de56febdc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:34:08Z',
'fuel_type': 'diesel',
'id': 'a4a198e5-cb7a-5e24-a6e2-812de56febdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP28978',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 19260,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Lodgy 1.5 Blue dCi Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2021}
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP28978%27 HTTP/1.1" 200 None
2026-01-27 21:01:18 [auto1.it] INFO: Saving data for DP28978: {'auction_closing_time': 1769618048.0, 'created_time': 1769458307.118125, 'last_price_update_time': 1769547678.662814}
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP28978') HTTP/1.1" 204 0
2026-01-27 21:01:18 [auto1.it] INFO: Found listing with ID: CD43232
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD43232%27 HTTP/1.1" 200 None
2026-01-27 21:01:18 [auto1.it] INFO: Scrape type for CD43232: 2
2026-01-27 21:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB68878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL92988> (referer: https://www.auto1.com/v1/car-details-view/CL92988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD40988> (referer: https://www.auto1.com/v1/car-details-view/BD40988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:18 [auto1.it] INFO: Found listing with ID: HH00112
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH00112%27 HTTP/1.1" 200 None
2026-01-27 21:01:18 [auto1.it] INFO: Scrape type for HH00112: 2
2026-01-27 21:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2c83e74-d397-5295-8dcf-0df2f7e64ec9 with identifier: EF33407
2026-01-27 21:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c83e74-d397-5295-8dcf-0df2f7e64ec9 with scrape type 2
2026-01-27 21:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2c83e74-d397-5295-8dcf-0df2f7e64ec9 with scrape type 2
2026-01-27 21:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d2c83e74-d397-5295-8dcf-0df2f7e64ec9, identifier: EF33407
2026-01-27 21:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d2c83e74-d397-5295-8dcf-0df2f7e64ec9 with identifier: EF33407
2026-01-27 21:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d2c83e74-d397-5295-8dcf-0df2f7e64ec9 with identifier: EF33407
2026-01-27 21:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d2c83e74-d397-5295-8dcf-0df2f7e64ec9 with identifier: EF33407 to the API
2026-01-27 21:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF33407>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:09:01Z',
'fuel_type': 'petrol',
'id': 'd2c83e74-d397-5295-8dcf-0df2f7e64ec9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF33407',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Opel',
'model': 'Corsa',
'odometer': 46876,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Design & Tech',
'transmission': 'manual',
'trim': 'Design & Tech',
'year': 2023}
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF33407%27 HTTP/1.1" 200 None
2026-01-27 21:01:19 [auto1.it] INFO: Saving data for EF33407: {'auction_closing_time': 1769616541.0, 'created_time': 1769025870.797879, 'last_price_update_time': 1769547679.125598}
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EF33407') HTTP/1.1" 204 0
2026-01-27 21:01:19 [auto1.it] INFO: Found listing with ID: CN82812
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN82812%27 HTTP/1.1" 200 None
2026-01-27 21:01:19 [auto1.it] INFO: Scrape type for CN82812: 2
2026-01-27 21:01:19 [auto1.it] INFO: Found listing with ID: TZ53924
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ53924%27 HTTP/1.1" 200 None
2026-01-27 21:01:19 [auto1.it] INFO: Scrape type for TZ53924: 2
2026-01-27 21:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988
2026-01-27 21:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b03466-c0af-5c66-b509-0906e6505589 with scrape type 2
2026-01-27 21:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b03466-c0af-5c66-b509-0906e6505589 with scrape type 2
2026-01-27 21:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3b03466-c0af-5c66-b509-0906e6505589, identifier: CL92988
2026-01-27 21:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56603981-e6d4-5a06-a941-3be6fa3fe34b with identifier: BD40988
2026-01-27 21:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56603981-e6d4-5a06-a941-3be6fa3fe34b with scrape type 2
2026-01-27 21:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56603981-e6d4-5a06-a941-3be6fa3fe34b with scrape type 2
2026-01-27 21:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56603981-e6d4-5a06-a941-3be6fa3fe34b, identifier: BD40988
2026-01-27 21:01:19 [auto1.it] INFO: Found listing with ID: DA21697
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21697%27 HTTP/1.1" 200 None
2026-01-27 21:01:19 [auto1.it] INFO: Scrape type for DA21697: 2
2026-01-27 21:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988
2026-01-27 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988
2026-01-27 21:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3b03466-c0af-5c66-b509-0906e6505589 with identifier: CL92988 to the API
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CL92988>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 122,
'expiration_date': '2026-01-28T16:40:36Z',
'fuel_type': 'petrol',
'id': 'd3b03466-c0af-5c66-b509-0906e6505589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL92988',
'listing': 'auction',
'location': 'IT, Segrate',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 113165,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL92988%27 HTTP/1.1" 200 None
2026-01-27 21:01:19 [auto1.it] INFO: Saving data for CL92988: {'auction_closing_time': 1769618436.0, 'created_time': 1769457988.602069, 'last_price_update_time': 1769547679.802135}
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CL92988') HTTP/1.1" 204 0
2026-01-27 21:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56603981-e6d4-5a06-a941-3be6fa3fe34b with identifier: BD40988
2026-01-27 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56603981-e6d4-5a06-a941-3be6fa3fe34b with identifier: BD40988
2026-01-27 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184254 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
184254
2026-01-27 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 56603981-e6d4-5a06-a941-3be6fa3fe34b spider: auto1.it
2026-01-27 21:01:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 56603981-e6d4-5a06-a941-3be6fa3fe34b due to rule: high_mileage_for_country.json, error: 184254 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
184254
{'auction_title': '',
'c_o_2_emission_value': 170,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:11:28Z',
'fuel_type': 'petrol',
'id': '56603981-e6d4-5a06-a941-3be6fa3fe34b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD40988',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Audi',
'model': 'Q3',
'odometer': 184254,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 40 TFSI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2019}
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD40988%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Saving data for BD40988: {'auction_closing_time': 1769616688.0, 'created_time': 1769458111.455823, 'last_price_update_time': 1769547680.020567}
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD40988') HTTP/1.1" 204 0
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: KK64864
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK64864%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for KK64864: 2
2026-01-27 21:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD32917> (referer: https://www.auto1.com/v1/car-details-view/TD32917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK38544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY77758> (referer: https://www.auto1.com/v1/car-details-view/EY77758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB94956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: TA01663
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA01663%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for TA01663: 2
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: ML31278
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML31278%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for ML31278: 0
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: ZT50467
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT50467%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for ZT50467: 0
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: FN81119
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81119%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for FN81119: 2
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: LX99964
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX99964%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for LX99964: 2
2026-01-27 21:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917
2026-01-27 21:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af16906b-b96f-5df7-9097-c83a0d205c08 with scrape type 2
2026-01-27 21:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af16906b-b96f-5df7-9097-c83a0d205c08 with scrape type 2
2026-01-27 21:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af16906b-b96f-5df7-9097-c83a0d205c08, identifier: TD32917
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: TB52041
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB52041%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for TB52041: 2
2026-01-27 21:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917
2026-01-27 21:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917
2026-01-27 21:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af16906b-b96f-5df7-9097-c83a0d205c08 with identifier: TD32917 to the API
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TD32917>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:30:32Z',
'fuel_type': 'petrol',
'id': 'af16906b-b96f-5df7-9097-c83a0d205c08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD32917',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 33572,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
'transmission': 'manual',
'trim': 'SportLine',
'year': 2023}
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD32917%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Saving data for TD32917: {'auction_closing_time': 1769617832.0, 'created_time': 1768075373.387265, 'last_price_update_time': 1769547680.598349}
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD32917') HTTP/1.1" 204 0
2026-01-27 21:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a57dd025-6178-5a44-9294-65a283bd5514 with identifier: EY77758
2026-01-27 21:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a57dd025-6178-5a44-9294-65a283bd5514 with scrape type 2
2026-01-27 21:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a57dd025-6178-5a44-9294-65a283bd5514 with scrape type 2
2026-01-27 21:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a57dd025-6178-5a44-9294-65a283bd5514, identifier: EY77758
2026-01-27 21:01:20 [auto1.it] INFO: Found listing with ID: CV26562
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-01-27 21:01:20 [auto1.it] INFO: Scrape type for CV26562: 2
2026-01-27 21:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a57dd025-6178-5a44-9294-65a283bd5514 with identifier: EY77758
2026-01-27 21:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a57dd025-6178-5a44-9294-65a283bd5514 with identifier: EY77758
2026-01-27 21:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a57dd025-6178-5a44-9294-65a283bd5514 with identifier: EY77758 to the API
2026-01-27 21:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY77758>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 300,
'expiration_date': '2026-01-28T16:27:41Z',
'fuel_type': 'petrol',
'id': 'a57dd025-6178-5a44-9294-65a283bd5514',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY77758',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 60486,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2020}
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY77758%27 HTTP/1.1" 200 None
2026-01-27 21:01:21 [auto1.it] INFO: Saving data for EY77758: {'auction_closing_time': 1769617661.0, 'created_time': 1768075248.228024, 'last_price_update_time': 1769547681.719603}
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY77758') HTTP/1.1" 204 0
2026-01-27 21:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC33365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:21 [auto1.it] INFO: Found listing with ID: NG74900
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74900%27 HTTP/1.1" 200 None
2026-01-27 21:01:21 [auto1.it] INFO: Scrape type for NG74900: 2
2026-01-27 21:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW18844> (referer: https://www.auto1.com/v1/car-details-view/WW18844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU65526> (referer: https://www.auto1.com/v1/car-details-view/NU65526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU67286> (referer: https://www.auto1.com/v1/car-details-view/CU67286/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:21 [auto1.it] INFO: Found listing with ID: BL68593
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL68593%27 HTTP/1.1" 200 None
2026-01-27 21:01:21 [auto1.it] INFO: Scrape type for BL68593: 0
2026-01-27 21:01:21 [auto1.it] INFO: Found listing with ID: EL05291
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2026-01-27 21:01:21 [auto1.it] INFO: Scrape type for EL05291: 2
2026-01-27 21:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:21 [auto1.it] INFO: Found listing with ID: XE90454
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE90454%27 HTTP/1.1" 200 None
2026-01-27 21:01:21 [auto1.it] INFO: Scrape type for XE90454: 0
2026-01-27 21:01:21 [auto1.it] INFO: Found listing with ID: ER23640
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER23640%27 HTTP/1.1" 200 None
2026-01-27 21:01:21 [auto1.it] INFO: Scrape type for ER23640: 0
2026-01-27 21:01:21 [auto1.it] INFO: Found listing with ID: LW49157
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW49157%27 HTTP/1.1" 200 None
2026-01-27 21:01:22 [auto1.it] INFO: Scrape type for LW49157: 0
2026-01-27 21:01:22 [auto1.it] INFO: Found listing with ID: DK89708
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK89708%27 HTTP/1.1" 200 None
2026-01-27 21:01:22 [auto1.it] INFO: Scrape type for DK89708: 0
2026-01-27 21:01:22 [auto1.it] INFO: Found listing with ID: JE72665
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE72665%27 HTTP/1.1" 200 None
2026-01-27 21:01:22 [auto1.it] INFO: Scrape type for JE72665: 2
2026-01-27 21:01:22 [auto1.it] INFO: Found listing with ID: FU00657
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU00657%27 HTTP/1.1" 200 None
2026-01-27 21:01:22 [auto1.it] INFO: Scrape type for FU00657: 2
2026-01-27 21:01:22 [auto1.it] INFO: Found listing with ID: JP83347
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP83347%27 HTTP/1.1" 200 None
2026-01-27 21:01:22 [auto1.it] INFO: Scrape type for JP83347: 2
2026-01-27 21:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19c49a3a-58f6-5225-99c4-9989c6d4f1f0 with identifier: WW18844
2026-01-27 21:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19c49a3a-58f6-5225-99c4-9989c6d4f1f0 with scrape type 2
2026-01-27 21:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19c49a3a-58f6-5225-99c4-9989c6d4f1f0 with scrape type 2
2026-01-27 21:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 19c49a3a-58f6-5225-99c4-9989c6d4f1f0, identifier: WW18844
2026-01-27 21:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7552f150-5946-5752-89a6-80911dad2ef0 with identifier: NU65526
2026-01-27 21:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7552f150-5946-5752-89a6-80911dad2ef0 with scrape type 2
2026-01-27 21:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7552f150-5946-5752-89a6-80911dad2ef0 with scrape type 2
2026-01-27 21:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7552f150-5946-5752-89a6-80911dad2ef0, identifier: NU65526
2026-01-27 21:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286
2026-01-27 21:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c517a10-fd07-5b95-b540-c0692eb5c6be with scrape type 2
2026-01-27 21:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c517a10-fd07-5b95-b540-c0692eb5c6be with scrape type 2
2026-01-27 21:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c517a10-fd07-5b95-b540-c0692eb5c6be, identifier: CU67286
2026-01-27 21:01:22 [auto1.it] INFO: Found listing with ID: SG87196
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG87196%27 HTTP/1.1" 200 None
2026-01-27 21:01:22 [auto1.it] INFO: Scrape type for SG87196: 2
2026-01-27 21:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 19c49a3a-58f6-5225-99c4-9989c6d4f1f0 with identifier: WW18844
2026-01-27 21:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 19c49a3a-58f6-5225-99c4-9989c6d4f1f0 with identifier: WW18844
2026-01-27 21:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 19c49a3a-58f6-5225-99c4-9989c6d4f1f0 with identifier: WW18844 to the API
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW18844>
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:57:20Z',
'fuel_type': 'diesel',
'id': '19c49a3a-58f6-5225-99c4-9989c6d4f1f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW18844',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 53109,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
'transmission': 'automatic',
'trim': 'Feel',
'year': 2020}
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW18844%27 HTTP/1.1" 200 None
2026-01-27 21:01:22 [auto1.it] INFO: Saving data for WW18844: {'auction_closing_time': 1769619440.0, 'created_time': 1769458410.118931, 'last_price_update_time': 1769547682.694946}
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW18844') HTTP/1.1" 204 0
2026-01-27 21:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7552f150-5946-5752-89a6-80911dad2ef0 with identifier: NU65526
2026-01-27 21:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7552f150-5946-5752-89a6-80911dad2ef0 with identifier: NU65526
2026-01-27 21:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7552f150-5946-5752-89a6-80911dad2ef0 with identifier: NU65526 to the API
2026-01-27 21:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NU65526>
{'auction_title': '',
'c_o_2_emission_value': 223,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 286,
'expiration_date': '2026-01-28T16:12:45Z',
'fuel_type': 'diesel',
'id': '7552f150-5946-5752-89a6-80911dad2ef0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU65526',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'Q8',
'odometer': 20409,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-01-02',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q8 50 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2025}
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU65526%27 HTTP/1.1" 200 None
2026-01-27 21:01:23 [auto1.it] INFO: Saving data for NU65526: {'auction_closing_time': 1769616765.0, 'created_time': 1769076199.478426, 'last_price_update_time': 1769547683.161108}
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NU65526') HTTP/1.1" 204 0
2026-01-27 21:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286
2026-01-27 21:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286
2026-01-27 21:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c517a10-fd07-5b95-b540-c0692eb5c6be with identifier: CU67286 to the API
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU67286>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 155,
'expiration_date': '2026-01-28T16:14:08Z',
'fuel_type': 'petrol',
'id': '7c517a10-fd07-5b95-b540-c0692eb5c6be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU67286',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Ford',
'model': 'Focus',
'odometer': 66769,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2021}
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU67286%27 HTTP/1.1" 200 None
2026-01-27 21:01:23 [auto1.it] INFO: Saving data for CU67286: {'auction_closing_time': 1769616848.0, 'created_time': 1769458448.89961, 'last_price_update_time': 1769547683.487525}
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU67286') HTTP/1.1" 204 0
2026-01-27 21:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE55553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM42307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR38065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW96093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU47975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD43232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW83392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX56399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK64864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB68878> (referer: https://www.auto1.com/v1/car-details-view/LB68878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878
2026-01-27 21:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with scrape type 2
2026-01-27 21:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with scrape type 2
2026-01-27 21:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48, identifier: LB68878
2026-01-27 21:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878
2026-01-27 21:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878
2026-01-27 21:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c1f0a8a-90db-5043-93d5-a4ea4fa78d48 with identifier: LB68878 to the API
2026-01-27 21:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LB68878>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-01-28T16:47:10Z',
'fuel_type': 'diesel',
'id': '5c1f0a8a-90db-5043-93d5-a4ea4fa78d48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB68878',
'listing': 'auction',
'location': 'IT, Casoria',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 140693,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 2.0 CDTI Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2018}
2026-01-27 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB68878%27 HTTP/1.1" 200 None
2026-01-27 21:01:24 [auto1.it] INFO: Saving data for LB68878: {'auction_closing_time': 1769618830.0, 'created_time': 1769457927.945014, 'last_price_update_time': 1769547684.943663}
2026-01-27 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB68878') HTTP/1.1" 204 0
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA21697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ53924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG74900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV26562/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB94956> (referer: https://www.auto1.com/v1/car-details-view/CB94956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a8d7948-0dcc-59b4-adc5-228fb8df88e0 with identifier: CB94956
2026-01-27 21:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a8d7948-0dcc-59b4-adc5-228fb8df88e0 with scrape type 2
2026-01-27 21:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a8d7948-0dcc-59b4-adc5-228fb8df88e0 with scrape type 2
2026-01-27 21:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a8d7948-0dcc-59b4-adc5-228fb8df88e0, identifier: CB94956
2026-01-27 21:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a8d7948-0dcc-59b4-adc5-228fb8df88e0 with identifier: CB94956
2026-01-27 21:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a8d7948-0dcc-59b4-adc5-228fb8df88e0 with identifier: CB94956
2026-01-27 21:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a8d7948-0dcc-59b4-adc5-228fb8df88e0 with identifier: CB94956 to the API
2026-01-27 21:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB94956>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-01-28T16:48:12Z',
'fuel_type': 'petrol',
'id': '9a8d7948-0dcc-59b4-adc5-228fb8df88e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB94956',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Volvo',
'model': 'XC60',
'odometer': 130979,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
'transmission': 'automatic',
'trim': 'Momentum Pro 2WD',
'year': 2020}
2026-01-27 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB94956%27 HTTP/1.1" 200 None
2026-01-27 21:01:25 [auto1.it] INFO: Saving data for CB94956: {'auction_closing_time': 1769618892.0, 'created_time': 1769457861.377813, 'last_price_update_time': 1769547685.801532}
2026-01-27 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB94956') HTTP/1.1" 204 0
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG87196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP83347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB52041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU00657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW96093> (referer: https://www.auto1.com/v1/car-details-view/AW96093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR38065> (referer: https://www.auto1.com/v1/car-details-view/NR38065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC33365> (referer: https://www.auto1.com/v1/car-details-view/PC33365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20404262-46b1-5c2b-8aeb-517a9b10a25f with identifier: AW96093
2026-01-27 21:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20404262-46b1-5c2b-8aeb-517a9b10a25f with scrape type 2
2026-01-27 21:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20404262-46b1-5c2b-8aeb-517a9b10a25f with scrape type 2
2026-01-27 21:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20404262-46b1-5c2b-8aeb-517a9b10a25f, identifier: AW96093
2026-01-27 21:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20404262-46b1-5c2b-8aeb-517a9b10a25f with identifier: AW96093
2026-01-27 21:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20404262-46b1-5c2b-8aeb-517a9b10a25f with identifier: AW96093
2026-01-27 21:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20404262-46b1-5c2b-8aeb-517a9b10a25f with identifier: AW96093 to the API
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW96093>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:15:58Z',
'fuel_type': 'diesel',
'id': '20404262-46b1-5c2b-8aeb-517a9b10a25f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW96093',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'BMW',
'model': 'X1',
'odometer': 84617,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2018}
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW96093%27 HTTP/1.1" 200 None
2026-01-27 21:01:26 [auto1.it] INFO: Saving data for AW96093: {'auction_closing_time': 1769616958.0, 'created_time': 1769458494.164243, 'last_price_update_time': 1769547686.440571}
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW96093') HTTP/1.1" 204 0
2026-01-27 21:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065
2026-01-27 21:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36640f4d-5f28-542f-9050-947e32237496 with scrape type 2
2026-01-27 21:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36640f4d-5f28-542f-9050-947e32237496 with scrape type 2
2026-01-27 21:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36640f4d-5f28-542f-9050-947e32237496, identifier: NR38065
2026-01-27 21:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be44041-6ed4-5d20-909a-7ff78d75adf5 with identifier: PC33365
2026-01-27 21:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be44041-6ed4-5d20-909a-7ff78d75adf5 with scrape type 2
2026-01-27 21:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8be44041-6ed4-5d20-909a-7ff78d75adf5 with scrape type 2
2026-01-27 21:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8be44041-6ed4-5d20-909a-7ff78d75adf5, identifier: PC33365
2026-01-27 21:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065
2026-01-27 21:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065
2026-01-27 21:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36640f4d-5f28-542f-9050-947e32237496 with identifier: NR38065 to the API
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NR38065>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:15:16Z',
'fuel_type': 'petrol',
'id': '36640f4d-5f28-542f-9050-947e32237496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR38065',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 46424,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2022}
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR38065%27 HTTP/1.1" 200 None
2026-01-27 21:01:26 [auto1.it] INFO: Saving data for NR38065: {'auction_closing_time': 1769616916.0, 'created_time': 1768248048.788999, 'last_price_update_time': 1769547686.94877}
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR38065') HTTP/1.1" 204 0
2026-01-27 21:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8be44041-6ed4-5d20-909a-7ff78d75adf5 with identifier: PC33365
2026-01-27 21:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8be44041-6ed4-5d20-909a-7ff78d75adf5 with identifier: PC33365
2026-01-27 21:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8be44041-6ed4-5d20-909a-7ff78d75adf5 with identifier: PC33365 to the API
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC33365>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:36:42Z',
'fuel_type': 'petrol',
'id': '8be44041-6ed4-5d20-909a-7ff78d75adf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC33365',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Kia',
'model': 'Stonic',
'odometer': 94977,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC33365%27 HTTP/1.1" 200 None
2026-01-27 21:01:27 [auto1.it] INFO: Saving data for PC33365: {'auction_closing_time': 1769618202.0, 'created_time': 1769458368.319789, 'last_price_update_time': 1769547687.254352}
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PC33365') HTTP/1.1" 204 0
2026-01-27 21:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM42307> (referer: https://www.auto1.com/v1/car-details-view/FM42307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW83392> (referer: https://www.auto1.com/v1/car-details-view/WW83392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD43232> (referer: https://www.auto1.com/v1/car-details-view/CD43232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU47975> (referer: https://www.auto1.com/v1/car-details-view/MU47975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK64864> (referer: https://www.auto1.com/v1/car-details-view/KK64864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57280661-867c-5e86-b315-4048f392230f with identifier: FM42307
2026-01-27 21:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57280661-867c-5e86-b315-4048f392230f with scrape type 2
2026-01-27 21:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57280661-867c-5e86-b315-4048f392230f with scrape type 2
2026-01-27 21:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57280661-867c-5e86-b315-4048f392230f, identifier: FM42307
2026-01-27 21:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392
2026-01-27 21:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bcbed7d-ef0f-58a4-ab35-12e37807741b with scrape type 2
2026-01-27 21:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bcbed7d-ef0f-58a4-ab35-12e37807741b with scrape type 2
2026-01-27 21:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bcbed7d-ef0f-58a4-ab35-12e37807741b, identifier: WW83392
2026-01-27 21:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232
2026-01-27 21:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d334aba-5ef8-5cd9-b891-843e39c74899 with scrape type 2
2026-01-27 21:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d334aba-5ef8-5cd9-b891-843e39c74899 with scrape type 2
2026-01-27 21:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d334aba-5ef8-5cd9-b891-843e39c74899, identifier: CD43232
2026-01-27 21:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57280661-867c-5e86-b315-4048f392230f with identifier: FM42307
2026-01-27 21:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57280661-867c-5e86-b315-4048f392230f with identifier: FM42307
2026-01-27 21:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57280661-867c-5e86-b315-4048f392230f with identifier: FM42307 to the API
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM42307>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.4L',
'engine_horse_power': 100,
'expiration_date': '2026-01-28T16:33:13Z',
'fuel_type': 'petrol',
'id': '57280661-867c-5e86-b315-4048f392230f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM42307',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Kia',
'model': 'Stonic',
'odometer': 77789,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-17',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.4 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-01-27 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM42307%27 HTTP/1.1" 200 None
2026-01-27 21:01:28 [auto1.it] INFO: Saving data for FM42307: {'auction_closing_time': 1769617993.0, 'created_time': 1769241656.30448, 'last_price_update_time': 1769547688.0026}
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FM42307') HTTP/1.1" 204 0
2026-01-27 21:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392
2026-01-27 21:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392
2026-01-27 21:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bcbed7d-ef0f-58a4-ab35-12e37807741b with identifier: WW83392 to the API
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW83392>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.4L',
'engine_horse_power': 165,
'expiration_date': '2026-01-28T16:36:23Z',
'fuel_type': 'petrol',
'id': '7bcbed7d-ef0f-58a4-ab35-12e37807741b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW83392',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Abarth',
'model': '595',
'odometer': 1520,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-04-22',
'seats_number': 4,
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83392%27 HTTP/1.1" 200 None
2026-01-27 21:01:28 [auto1.it] INFO: Saving data for WW83392: {'auction_closing_time': 1769618183.0, 'created_time': 1769457945.95306, 'last_price_update_time': 1769547688.523455}
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW83392') HTTP/1.1" 204 0
2026-01-27 21:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232
2026-01-27 21:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232
2026-01-27 21:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5d334aba-5ef8-5cd9-b891-843e39c74899 with identifier: CD43232 to the API
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD43232>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:10:30Z',
'fuel_type': 'diesel',
'id': '5d334aba-5ef8-5cd9-b891-843e39c74899',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD43232',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 117245,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi S-Edition',
'transmission': 'manual',
'trim': 'S-Edition',
'year': 2019}
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD43232%27 HTTP/1.1" 200 None
2026-01-27 21:01:28 [auto1.it] INFO: Saving data for CD43232: {'auction_closing_time': 1769616630.0, 'created_time': 1769458340.349053, 'last_price_update_time': 1769547688.841925}
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD43232') HTTP/1.1" 204 0
2026-01-27 21:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1967c94-8f1e-5325-8ec2-cb5d391e3402 with identifier: MU47975
2026-01-27 21:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1967c94-8f1e-5325-8ec2-cb5d391e3402 with scrape type 2
2026-01-27 21:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1967c94-8f1e-5325-8ec2-cb5d391e3402 with scrape type 2
2026-01-27 21:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d1967c94-8f1e-5325-8ec2-cb5d391e3402, identifier: MU47975
2026-01-27 21:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864
2026-01-27 21:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd9d12d-8e10-5765-89c5-b64d6df63883 with scrape type 2
2026-01-27 21:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dd9d12d-8e10-5765-89c5-b64d6df63883 with scrape type 2
2026-01-27 21:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5dd9d12d-8e10-5765-89c5-b64d6df63883, identifier: KK64864
2026-01-27 21:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE72665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE55553> (referer: https://www.auto1.com/v1/car-details-view/DE55553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX56399> (referer: https://www.auto1.com/v1/car-details-view/LX56399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d1967c94-8f1e-5325-8ec2-cb5d391e3402 with identifier: MU47975
2026-01-27 21:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d1967c94-8f1e-5325-8ec2-cb5d391e3402 with identifier: MU47975
2026-01-27 21:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d1967c94-8f1e-5325-8ec2-cb5d391e3402 with identifier: MU47975 to the API
2026-01-27 21:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MU47975>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '3.0L',
'engine_horse_power': 340,
'expiration_date': '2026-01-28T16:02:43Z',
'fuel_type': 'diesel',
'id': 'd1967c94-8f1e-5325-8ec2-cb5d391e3402',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU47975',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'BMW',
'model': 'X3',
'odometer': 102145,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 M40d Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47975%27 HTTP/1.1" 200 None
2026-01-27 21:01:30 [auto1.it] INFO: Saving data for MU47975: {'auction_closing_time': 1769616163.0, 'created_time': 1769076462.047154, 'last_price_update_time': 1769547690.296632}
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU47975') HTTP/1.1" 204 0
2026-01-27 21:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864
2026-01-27 21:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864
2026-01-27 21:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864 to the API
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK64864>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 231,
'expiration_date': '2026-01-28T16:17:11Z',
'fuel_type': 'petrol',
'id': '5dd9d12d-8e10-5765-89c5-b64d6df63883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK64864',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'MINI',
'model': 'MINI',
'odometer': 39769,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-11',
'seats_number': 4,
'seller_name': None,
'title': 'MINI John Cooper Works Essential Trim',
'transmission': 'automatic',
'trim': 'Essential Trim',
'year': 2023}
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK64864%27 HTTP/1.1" 200 None
2026-01-27 21:01:30 [auto1.it] INFO: Saving data for KK64864: {'auction_closing_time': 1769617031.0, 'created_time': 1769076521.331851, 'last_price_update_time': 1769547690.683014}
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK64864') HTTP/1.1" 204 0
2026-01-27 21:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7082e32c-8d09-50d9-99f3-3009245eb214 with identifier: DE55553
2026-01-27 21:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7082e32c-8d09-50d9-99f3-3009245eb214 with scrape type 2
2026-01-27 21:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7082e32c-8d09-50d9-99f3-3009245eb214 with scrape type 2
2026-01-27 21:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7082e32c-8d09-50d9-99f3-3009245eb214, identifier: DE55553
2026-01-27 21:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10c3a829-2219-596f-9765-6f4ea2089814 with identifier: LX56399
2026-01-27 21:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c3a829-2219-596f-9765-6f4ea2089814 with scrape type 2
2026-01-27 21:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10c3a829-2219-596f-9765-6f4ea2089814 with scrape type 2
2026-01-27 21:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10c3a829-2219-596f-9765-6f4ea2089814, identifier: LX56399
2026-01-27 21:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7082e32c-8d09-50d9-99f3-3009245eb214 with identifier: DE55553
2026-01-27 21:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7082e32c-8d09-50d9-99f3-3009245eb214 with identifier: DE55553
2026-01-27 21:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174303 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174303
2026-01-27 21:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7082e32c-8d09-50d9-99f3-3009245eb214 spider: auto1.it
2026-01-27 21:01:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 7082e32c-8d09-50d9-99f3-3009245eb214 due to rule: high_mileage_for_country.json, error: 174303 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174303
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:46:47Z',
'fuel_type': 'diesel',
'id': '7082e32c-8d09-50d9-99f3-3009245eb214',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE55553',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Audi',
'model': 'Q3',
'odometer': 174303,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE55553%27 HTTP/1.1" 200 None
2026-01-27 21:01:31 [auto1.it] INFO: Saving data for DE55553: {'auction_closing_time': 1769618807.0, 'created_time': 1768593794.909514, 'last_price_update_time': 1769547691.552657}
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE55553') HTTP/1.1" 204 0
2026-01-27 21:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10c3a829-2219-596f-9765-6f4ea2089814 with identifier: LX56399
2026-01-27 21:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10c3a829-2219-596f-9765-6f4ea2089814 with identifier: LX56399
2026-01-27 21:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10c3a829-2219-596f-9765-6f4ea2089814 with identifier: LX56399 to the API
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX56399>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:34:46Z',
'fuel_type': 'diesel',
'id': '10c3a829-2219-596f-9765-6f4ea2089814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX56399',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 56504,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX56399%27 HTTP/1.1" 200 None
2026-01-27 21:01:31 [auto1.it] INFO: Saving data for LX56399: {'auction_closing_time': 1769618086.0, 'created_time': 1768557790.57343, 'last_price_update_time': 1769547691.946267}
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX56399') HTTP/1.1" 204 0
2026-01-27 21:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG74900> (referer: https://www.auto1.com/v1/car-details-view/NG74900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ53924> (referer: https://www.auto1.com/v1/car-details-view/TZ53924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA21697> (referer: https://www.auto1.com/v1/car-details-view/DA21697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV26562> (referer: https://www.auto1.com/v1/car-details-view/CV26562/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL05291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900
2026-01-27 21:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be62ec41-2206-5668-b03c-7175e697eaa9 with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be62ec41-2206-5668-b03c-7175e697eaa9 with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be62ec41-2206-5668-b03c-7175e697eaa9, identifier: NG74900
2026-01-27 21:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900
2026-01-27 21:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900
2026-01-27 21:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be62ec41-2206-5668-b03c-7175e697eaa9 with identifier: NG74900 to the API
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG74900>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-01-28T16:37:19Z',
'fuel_type': 'petrol',
'id': 'be62ec41-2206-5668-b03c-7175e697eaa9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG74900',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 12483,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2022}
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74900%27 HTTP/1.1" 200 None
2026-01-27 21:01:32 [auto1.it] INFO: Saving data for NG74900: {'auction_closing_time': 1769618239.0, 'created_time': 1768939273.148088, 'last_price_update_time': 1769547692.457169}
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG74900') HTTP/1.1" 204 0
2026-01-27 21:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5524d582-c617-5a82-ac53-38a8c84c70f8 with identifier: TZ53924
2026-01-27 21:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5524d582-c617-5a82-ac53-38a8c84c70f8 with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5524d582-c617-5a82-ac53-38a8c84c70f8 with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5524d582-c617-5a82-ac53-38a8c84c70f8, identifier: TZ53924
2026-01-27 21:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697
2026-01-27 21:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42375cb1-8ae2-5920-8baa-7510090967c2 with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42375cb1-8ae2-5920-8baa-7510090967c2 with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42375cb1-8ae2-5920-8baa-7510090967c2, identifier: DA21697
2026-01-27 21:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-01-27 21:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with scrape type 2
2026-01-27 21:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b, identifier: CV26562
2026-01-27 21:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5524d582-c617-5a82-ac53-38a8c84c70f8 with identifier: TZ53924
2026-01-27 21:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5524d582-c617-5a82-ac53-38a8c84c70f8 with identifier: TZ53924
2026-01-27 21:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5524d582-c617-5a82-ac53-38a8c84c70f8 with identifier: TZ53924 to the API
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ53924>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:36:27Z',
'fuel_type': 'diesel',
'id': '5524d582-c617-5a82-ac53-38a8c84c70f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ53924',
'listing': 'auction',
'location': 'IT, Surbo',
'make': 'Fiat',
'model': '500X',
'odometer': 126732,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM S-Design',
'transmission': 'manual',
'trim': 'S-Design',
'year': 2018}
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ53924%27 HTTP/1.1" 200 None
2026-01-27 21:01:33 [auto1.it] INFO: Saving data for TZ53924: {'auction_closing_time': 1769618187.0, 'created_time': 1769458199.194645, 'last_price_update_time': 1769547693.149433}
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ53924') HTTP/1.1" 204 0
2026-01-27 21:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697
2026-01-27 21:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697
2026-01-27 21:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42375cb1-8ae2-5920-8baa-7510090967c2 with identifier: DA21697 to the API
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA21697>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 114,
'expiration_date': '2026-01-28T16:53:39Z',
'fuel_type': 'gas',
'id': '42375cb1-8ae2-5920-8baa-7510090967c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA21697',
'listing': 'auction',
'location': 'Roma RM',
'make': 'DR',
'model': 'DR 5.0',
'odometer': 15661,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 5.0 1.5 LPG Unica',
'transmission': 'manual',
'trim': 'Unica',
'year': 2024}
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21697%27 HTTP/1.1" 200 None
2026-01-27 21:01:33 [auto1.it] INFO: Saving data for DA21697: {'auction_closing_time': 1769619219.0, 'created_time': 1769458599.68537, 'last_price_update_time': 1769547693.480594}
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA21697') HTTP/1.1" 204 0
2026-01-27 21:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-01-27 21:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-01-27 21:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562 to the API
2026-01-27 21:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CV26562>
{'auction_title': '',
'c_o_2_emission_value': 184,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:55:50Z',
'fuel_type': 'petrol',
'id': 'b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV26562',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 36904,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 40 TFSI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2022}
2026-01-27 21:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-01-27 21:01:34 [auto1.it] INFO: Saving data for CV26562: {'auction_closing_time': 1769619350.0, 'created_time': 1768507255.173891, 'last_price_update_time': 1769547694.864314}
2026-01-27 21:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV26562') HTTP/1.1" 204 0
2026-01-27 21:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU00657> (referer: https://www.auto1.com/v1/car-details-view/FU00657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB52041> (referer: https://www.auto1.com/v1/car-details-view/TB52041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP83347> (referer: https://www.auto1.com/v1/car-details-view/JP83347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657
2026-01-27 21:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b199191a-2aae-5167-a745-f183d8bff009 with scrape type 2
2026-01-27 21:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b199191a-2aae-5167-a745-f183d8bff009 with scrape type 2
2026-01-27 21:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b199191a-2aae-5167-a745-f183d8bff009, identifier: FU00657
2026-01-27 21:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041
2026-01-27 21:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5451a90-56cf-5e3c-874a-c2a6f7999378 with scrape type 2
2026-01-27 21:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5451a90-56cf-5e3c-874a-c2a6f7999378 with scrape type 2
2026-01-27 21:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d5451a90-56cf-5e3c-874a-c2a6f7999378, identifier: TB52041
2026-01-27 21:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657
2026-01-27 21:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657
2026-01-27 21:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b199191a-2aae-5167-a745-f183d8bff009 with identifier: FU00657 to the API
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FU00657>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-01-28T16:56:07Z',
'fuel_type': 'diesel',
'id': 'b199191a-2aae-5167-a745-f183d8bff009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU00657',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'BMW',
'model': '5er',
'odometer': 103713,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2018}
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU00657%27 HTTP/1.1" 200 None
2026-01-27 21:01:35 [auto1.it] INFO: Saving data for FU00657: {'auction_closing_time': 1769619367.0, 'created_time': 1767816353.381926, 'last_price_update_time': 1769547695.490617}
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU00657') HTTP/1.1" 204 0
2026-01-27 21:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041
2026-01-27 21:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041
2026-01-27 21:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d5451a90-56cf-5e3c-874a-c2a6f7999378 with identifier: TB52041 to the API
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB52041>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:18:27Z',
'fuel_type': 'diesel',
'id': 'd5451a90-56cf-5e3c-874a-c2a6f7999378',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB52041',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 142886,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-13',
'seats_number': 7,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB52041%27 HTTP/1.1" 200 None
2026-01-27 21:01:35 [auto1.it] INFO: Saving data for TB52041: {'auction_closing_time': 1769617107.0, 'created_time': 1768939590.398004, 'last_price_update_time': 1769547695.802226}
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB52041') HTTP/1.1" 204 0
2026-01-27 21:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX99964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN81119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA01663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK38544> (referer: https://www.auto1.com/v1/car-details-view/SK38544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b with identifier: JP83347
2026-01-27 21:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4fdc96-6942-59ee-a84f-0835f3c6207b with scrape type 2
2026-01-27 21:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4fdc96-6942-59ee-a84f-0835f3c6207b with scrape type 2
2026-01-27 21:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c4fdc96-6942-59ee-a84f-0835f3c6207b, identifier: JP83347
2026-01-27 21:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG87196> (referer: https://www.auto1.com/v1/car-details-view/SG87196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b with identifier: JP83347
2026-01-27 21:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b with identifier: JP83347
2026-01-27 21:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo courier' containing 'courier'
2026-01-27 21:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5c4fdc96-6942-59ee-a84f-0835f3c6207b spider: auto1.it
2026-01-27 21:01:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5c4fdc96-6942-59ee-a84f-0835f3c6207b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo courier' containing 'courier'
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-28T16:26:22Z',
'fuel_type': 'petrol',
'id': '5c4fdc96-6942-59ee-a84f-0835f3c6207b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP83347',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Ford',
'model': 'Tourneo Courier',
'odometer': 18232,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Tourneo Courier 1.0 EcoBoost Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2024}
2026-01-27 21:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP83347%27 HTTP/1.1" 200 None
2026-01-27 21:01:36 [auto1.it] INFO: Saving data for JP83347: {'auction_closing_time': 1769617582.0, 'created_time': 1769458193.720872, 'last_price_update_time': 1769547696.127002}
2026-01-27 21:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP83347') HTTP/1.1" 204 0
2026-01-27 21:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e13210-31ed-5be9-b085-059455a300e3 with identifier: SK38544
2026-01-27 21:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e13210-31ed-5be9-b085-059455a300e3 with scrape type 2
2026-01-27 21:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44e13210-31ed-5be9-b085-059455a300e3 with scrape type 2
2026-01-27 21:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 44e13210-31ed-5be9-b085-059455a300e3, identifier: SK38544
2026-01-27 21:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196
2026-01-27 21:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8841630-1e22-5a95-997d-83beeb9915b4 with scrape type 2
2026-01-27 21:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8841630-1e22-5a95-997d-83beeb9915b4 with scrape type 2
2026-01-27 21:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8841630-1e22-5a95-997d-83beeb9915b4, identifier: SG87196
2026-01-27 21:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 44e13210-31ed-5be9-b085-059455a300e3 with identifier: SK38544
2026-01-27 21:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 44e13210-31ed-5be9-b085-059455a300e3 with identifier: SK38544
2026-01-27 21:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 44e13210-31ed-5be9-b085-059455a300e3 with identifier: SK38544 to the API
2026-01-27 21:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SK38544>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-01-28T16:26:10Z',
'fuel_type': 'petrol',
'id': '44e13210-31ed-5be9-b085-059455a300e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK38544',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': '500C',
'odometer': 75544,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-25',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500C 1.0 Mild-Hybrid Cult',
'transmission': 'manual',
'trim': 'Cult',
'year': 2022}
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK38544%27 HTTP/1.1" 200 None
2026-01-27 21:01:37 [auto1.it] INFO: Saving data for SK38544: {'auction_closing_time': 1769617570.0, 'created_time': 1769458217.249886, 'last_price_update_time': 1769547697.299229}
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK38544') HTTP/1.1" 204 0
2026-01-27 21:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196
2026-01-27 21:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196
2026-01-27 21:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8841630-1e22-5a95-997d-83beeb9915b4 with identifier: SG87196 to the API
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SG87196>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-28T16:38:18Z',
'fuel_type': 'petrol',
'id': 'a8841630-1e22-5a95-997d-83beeb9915b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG87196',
'listing': 'auction',
'location': 'IT, Rocca di Papa',
'make': 'Ford',
'model': 'Puma',
'odometer': 97081,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2021}
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG87196%27 HTTP/1.1" 200 None
2026-01-27 21:01:37 [auto1.it] INFO: Saving data for SG87196: {'auction_closing_time': 1769618298.0, 'created_time': 1769458336.126488, 'last_price_update_time': 1769547697.624203}
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG87196') HTTP/1.1" 204 0
2026-01-27 21:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN82812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK92644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH00112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC09499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE72665> (referer: https://www.auto1.com/v1/car-details-view/JE72665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW59498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL05088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665
2026-01-27 21:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7412e6c5-65bb-5ff0-a488-bd6986290893 with scrape type 2
2026-01-27 21:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7412e6c5-65bb-5ff0-a488-bd6986290893 with scrape type 2
2026-01-27 21:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7412e6c5-65bb-5ff0-a488-bd6986290893, identifier: JE72665
2026-01-27 21:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665
2026-01-27 21:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665
2026-01-27 21:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7412e6c5-65bb-5ff0-a488-bd6986290893 with identifier: JE72665 to the API
2026-01-27 21:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE72665>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:46:57Z',
'fuel_type': 'petrol',
'id': '7412e6c5-65bb-5ff0-a488-bd6986290893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE72665',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Seat',
'model': 'Arona',
'odometer': 84367,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.0 TSI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2019}
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE72665%27 HTTP/1.1" 200 None
2026-01-27 21:01:39 [auto1.it] INFO: Saving data for JE72665: {'auction_closing_time': 1769618817.0, 'created_time': 1768507498.190974, 'last_price_update_time': 1769547699.293121}
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE72665') HTTP/1.1" 204 0
2026-01-27 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL59630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN24419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL05291> (referer: https://www.auto1.com/v1/car-details-view/EL05291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP36812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bc3f531-e2be-5af5-8f91-7458330e533c with identifier: EL05291
2026-01-27 21:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bc3f531-e2be-5af5-8f91-7458330e533c with scrape type 2
2026-01-27 21:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bc3f531-e2be-5af5-8f91-7458330e533c with scrape type 2
2026-01-27 21:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8bc3f531-e2be-5af5-8f91-7458330e533c, identifier: EL05291
2026-01-27 21:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8bc3f531-e2be-5af5-8f91-7458330e533c with identifier: EL05291
2026-01-27 21:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8bc3f531-e2be-5af5-8f91-7458330e533c with identifier: EL05291
2026-01-27 21:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191911 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191911
2026-01-27 21:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8bc3f531-e2be-5af5-8f91-7458330e533c spider: auto1.it
2026-01-27 21:01:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8bc3f531-e2be-5af5-8f91-7458330e533c due to rule: high_mileage_for_country.json, error: 191911 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191911
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2026-01-28T16:23:15Z',
'fuel_type': 'diesel',
'id': '8bc3f531-e2be-5af5-8f91-7458330e533c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL05291',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 191911,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic SE',
'transmission': 'automatic',
'trim': 'R-Dynamic SE',
'year': 2020}
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2026-01-27 21:01:39 [auto1.it] INFO: Saving data for EL05291: {'auction_closing_time': 1769617395.0, 'created_time': 1767384092.342217, 'last_price_update_time': 1769547699.731154}
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EL05291') HTTP/1.1" 204 0
2026-01-27 21:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT86640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE10991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU67161> (referer: https://www.auto1.com/v1/car-details-view/UU67161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA01663> (referer: https://www.auto1.com/v1/car-details-view/TA01663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72a8509-39f5-51ae-93ae-3ba07398fd7f with identifier: UU67161
2026-01-27 21:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72a8509-39f5-51ae-93ae-3ba07398fd7f with scrape type 2
2026-01-27 21:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72a8509-39f5-51ae-93ae-3ba07398fd7f with scrape type 2
2026-01-27 21:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a72a8509-39f5-51ae-93ae-3ba07398fd7f, identifier: UU67161
2026-01-27 21:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a72a8509-39f5-51ae-93ae-3ba07398fd7f with identifier: UU67161
2026-01-27 21:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:01:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-01-27 21:01:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a72a8509-39f5-51ae-93ae-3ba07398fd7f with identifier: UU67161
2026-01-27 21:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a72a8509-39f5-51ae-93ae-3ba07398fd7f with identifier: UU67161 to the API
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UU67161>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:31:10Z',
'fuel_type': 'petrol',
'id': 'a72a8509-39f5-51ae-93ae-3ba07398fd7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU67161',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 35163,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Summit',
'transmission': 'manual',
'trim': 'Summit',
'year': 2023}
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU67161%27 HTTP/1.1" 200 None
2026-01-27 21:01:41 [auto1.it] INFO: Saving data for UU67161: {'auction_closing_time': 1769617870.0, 'created_time': 1769458089.642721, 'last_price_update_time': 1769547701.325523}
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU67161') HTTP/1.1" 204 0
2026-01-27 21:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX99964> (referer: https://www.auto1.com/v1/car-details-view/LX99964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN81119> (referer: https://www.auto1.com/v1/car-details-view/FN81119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU99342> (referer: https://www.auto1.com/v1/car-details-view/WU99342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH00112> (referer: https://www.auto1.com/v1/car-details-view/HH00112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK92644> (referer: https://www.auto1.com/v1/car-details-view/YK92644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070fa3f1-0adf-5464-9f36-76c9b4cb57f6 with identifier: TA01663
2026-01-27 21:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070fa3f1-0adf-5464-9f36-76c9b4cb57f6 with scrape type 2
2026-01-27 21:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070fa3f1-0adf-5464-9f36-76c9b4cb57f6 with scrape type 2
2026-01-27 21:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 070fa3f1-0adf-5464-9f36-76c9b4cb57f6, identifier: TA01663
2026-01-27 21:01:41 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 070fa3f1-0adf-5464-9f36-76c9b4cb57f6 with identifier: TA01663
2026-01-27 21:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 070fa3f1-0adf-5464-9f36-76c9b4cb57f6 with identifier: TA01663
2026-01-27 21:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 070fa3f1-0adf-5464-9f36-76c9b4cb57f6 with identifier: TA01663 to the API
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA01663>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-01-28T16:23:37Z',
'fuel_type': 'diesel',
'id': '070fa3f1-0adf-5464-9f36-76c9b4cb57f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA01663',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jeep',
'model': 'Compass',
'odometer': 144411,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2018}
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA01663%27 HTTP/1.1" 200 None
2026-01-27 21:01:41 [auto1.it] INFO: Saving data for TA01663: {'auction_closing_time': 1769617417.0, 'created_time': 1769458118.476025, 'last_price_update_time': 1769547701.757192}
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TA01663') HTTP/1.1" 204 0
2026-01-27 21:01:41 [auto1.it] INFO: Found listing with ID: YY06074
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-01-27 21:01:41 [auto1.it] INFO: Scrape type for YY06074: 2
2026-01-27 21:01:41 [auto1.it] INFO: Found listing with ID: GR38482
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR38482%27 HTTP/1.1" 200 None
2026-01-27 21:01:41 [auto1.it] INFO: Scrape type for GR38482: 2
2026-01-27 21:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964
2026-01-27 21:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3810cb8d-87f3-5cc0-941e-685807b3fb18 with scrape type 2
2026-01-27 21:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3810cb8d-87f3-5cc0-941e-685807b3fb18 with scrape type 2
2026-01-27 21:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3810cb8d-87f3-5cc0-941e-685807b3fb18, identifier: LX99964
2026-01-27 21:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with identifier: FN81119
2026-01-27 21:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with scrape type 2
2026-01-27 21:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with scrape type 2
2026-01-27 21:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f249ce98-94a1-5ac4-b7db-5b0eb181ab35, identifier: FN81119
2026-01-27 21:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de497fd6-12f8-5b9a-9893-34c39e9cfa32 with identifier: WU99342
2026-01-27 21:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de497fd6-12f8-5b9a-9893-34c39e9cfa32 with scrape type 2
2026-01-27 21:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de497fd6-12f8-5b9a-9893-34c39e9cfa32 with scrape type 2
2026-01-27 21:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de497fd6-12f8-5b9a-9893-34c39e9cfa32, identifier: WU99342
2026-01-27 21:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b5d047c-59c6-5f75-86e4-77679ba8599f with identifier: HH00112
2026-01-27 21:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b5d047c-59c6-5f75-86e4-77679ba8599f with scrape type 2
2026-01-27 21:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b5d047c-59c6-5f75-86e4-77679ba8599f with scrape type 2
2026-01-27 21:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b5d047c-59c6-5f75-86e4-77679ba8599f, identifier: HH00112
2026-01-27 21:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1139fdd-241d-5f6d-919d-b5bd99c517d0 with identifier: YK92644
2026-01-27 21:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1139fdd-241d-5f6d-919d-b5bd99c517d0 with scrape type 2
2026-01-27 21:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1139fdd-241d-5f6d-919d-b5bd99c517d0 with scrape type 2
2026-01-27 21:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d1139fdd-241d-5f6d-919d-b5bd99c517d0, identifier: YK92644
2026-01-27 21:01:42 [auto1.it] INFO: Found listing with ID: PX08238
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX08238%27 HTTP/1.1" 200 None
2026-01-27 21:01:42 [auto1.it] INFO: Scrape type for PX08238: 2
2026-01-27 21:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964
2026-01-27 21:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964
2026-01-27 21:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964 to the API
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX99964>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:43:32Z',
'fuel_type': 'petrol',
'id': '3810cb8d-87f3-5cc0-941e-685807b3fb18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX99964',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 73800,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2021}
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX99964%27 HTTP/1.1" 200 None
2026-01-27 21:01:42 [auto1.it] INFO: Saving data for LX99964: {'auction_closing_time': 1769618612.0, 'created_time': 1769458315.527013, 'last_price_update_time': 1769547702.704609}
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX99964') HTTP/1.1" 204 0
2026-01-27 21:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with identifier: FN81119
2026-01-27 21:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with identifier: FN81119
2026-01-27 21:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166572 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166572
2026-01-27 21:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 spider: auto1.it
2026-01-27 21:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 due to rule: high_mileage_for_country.json, error: 166572 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166572
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-01-28T16:58:41Z',
'fuel_type': 'diesel',
'id': 'f249ce98-94a1-5ac4-b7db-5b0eb181ab35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN81119',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Peugeot',
'model': '3008',
'odometer': 166572,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81119%27 HTTP/1.1" 200 None
2026-01-27 21:01:42 [auto1.it] INFO: Saving data for FN81119: {'auction_closing_time': 1769619521.0, 'created_time': 1767643304.906549, 'last_price_update_time': 1769547702.955305}
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN81119') HTTP/1.1" 204 0
2026-01-27 21:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de497fd6-12f8-5b9a-9893-34c39e9cfa32 with identifier: WU99342
2026-01-27 21:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de497fd6-12f8-5b9a-9893-34c39e9cfa32 with identifier: WU99342
2026-01-27 21:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de497fd6-12f8-5b9a-9893-34c39e9cfa32 with identifier: WU99342 to the API
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU99342>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:32:26Z',
'fuel_type': 'petrol',
'id': 'de497fd6-12f8-5b9a-9893-34c39e9cfa32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU99342',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 53281,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'manual',
'trim': 'R-Line',
'year': 2023}
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU99342%27 HTTP/1.1" 200 None
2026-01-27 21:01:43 [auto1.it] INFO: Saving data for WU99342: {'auction_closing_time': 1769617946.0, 'created_time': 1769458084.29881, 'last_price_update_time': 1769547703.278073}
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU99342') HTTP/1.1" 204 0
2026-01-27 21:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b5d047c-59c6-5f75-86e4-77679ba8599f with identifier: HH00112
2026-01-27 21:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b5d047c-59c6-5f75-86e4-77679ba8599f with identifier: HH00112
2026-01-27 21:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b5d047c-59c6-5f75-86e4-77679ba8599f with identifier: HH00112 to the API
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH00112>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:01:33Z',
'fuel_type': 'petrol',
'id': '4b5d047c-59c6-5f75-86e4-77679ba8599f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH00112',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 27915,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Longitude',
'transmission': 'manual',
'trim': 'Longitude',
'year': 2024}
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH00112%27 HTTP/1.1" 200 None
2026-01-27 21:01:43 [auto1.it] INFO: Saving data for HH00112: {'auction_closing_time': 1769616093.0, 'created_time': 1769025839.506529, 'last_price_update_time': 1769547703.654896}
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH00112') HTTP/1.1" 204 0
2026-01-27 21:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d1139fdd-241d-5f6d-919d-b5bd99c517d0 with identifier: YK92644
2026-01-27 21:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d1139fdd-241d-5f6d-919d-b5bd99c517d0 with identifier: YK92644
2026-01-27 21:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d1139fdd-241d-5f6d-919d-b5bd99c517d0 with identifier: YK92644 to the API
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YK92644>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:12:43Z',
'fuel_type': 'diesel',
'id': 'd1139fdd-241d-5f6d-919d-b5bd99c517d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK92644',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 6069,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK92644%27 HTTP/1.1" 200 None
2026-01-27 21:01:43 [auto1.it] INFO: Saving data for YK92644: {'auction_closing_time': 1769616763.0, 'created_time': 1768817292.97704, 'last_price_update_time': 1769547703.944792}
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YK92644') HTTP/1.1" 204 0
2026-01-27 21:01:43 [auto1.it] INFO: Found listing with ID: LK01725
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK01725%27 HTTP/1.1" 200 None
2026-01-27 21:01:43 [auto1.it] INFO: Scrape type for LK01725: 2
2026-01-27 21:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN82812> (referer: https://www.auto1.com/v1/car-details-view/CN82812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA44025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC09499> (referer: https://www.auto1.com/v1/car-details-view/YC09499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:44 [auto1.it] INFO: Found listing with ID: FJ30695
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ30695%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Scrape type for FJ30695: 0
2026-01-27 21:01:44 [auto1.it] INFO: Found listing with ID: VH04520
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH04520%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Scrape type for VH04520: 2
2026-01-27 21:01:44 [auto1.it] INFO: Found listing with ID: SN16265
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN16265%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Scrape type for SN16265: 2
2026-01-27 21:01:44 [auto1.it] INFO: Found listing with ID: TF46047
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF46047%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Scrape type for TF46047: 2
2026-01-27 21:01:44 [auto1.it] INFO: Found listing with ID: BR13535
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR13535%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Scrape type for BR13535: 2
2026-01-27 21:01:44 [auto1.it] INFO: Found listing with ID: LP49742
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP49742%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Scrape type for LP49742: 2
2026-01-27 21:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812
2026-01-27 21:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd6a2dda-6524-508f-b995-6c740d76d25f with scrape type 2
2026-01-27 21:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd6a2dda-6524-508f-b995-6c740d76d25f with scrape type 2
2026-01-27 21:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd6a2dda-6524-508f-b995-6c740d76d25f, identifier: CN82812
2026-01-27 21:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499
2026-01-27 21:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1c7450-019d-5309-9bf8-573cd3362ba6 with scrape type 2
2026-01-27 21:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd1c7450-019d-5309-9bf8-573cd3362ba6 with scrape type 2
2026-01-27 21:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd1c7450-019d-5309-9bf8-573cd3362ba6, identifier: YC09499
2026-01-27 21:01:44 [auto1.it] INFO: Found listing with ID: KZ21424
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ21424%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Scrape type for KZ21424: 2
2026-01-27 21:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812
2026-01-27 21:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812
2026-01-27 21:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd6a2dda-6524-508f-b995-6c740d76d25f with identifier: CN82812 to the API
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN82812>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 129,
'expiration_date': '2026-01-28T16:41:13Z',
'fuel_type': 'petrol',
'id': 'fd6a2dda-6524-508f-b995-6c740d76d25f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN82812',
'listing': 'auction',
'location': 'IT, Casamassima',
'make': 'Volvo',
'model': 'XC40',
'odometer': 15183,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T2 Core 2WD',
'transmission': 'manual',
'trim': 'Core 2WD',
'year': 2022}
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN82812%27 HTTP/1.1" 200 None
2026-01-27 21:01:44 [auto1.it] INFO: Saving data for CN82812: {'auction_closing_time': 1769618473.0, 'created_time': 1769457903.5593, 'last_price_update_time': 1769547704.647213}
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CN82812') HTTP/1.1" 204 0
2026-01-27 21:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499
2026-01-27 21:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499
2026-01-27 21:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd1c7450-019d-5309-9bf8-573cd3362ba6 with identifier: YC09499 to the API
2026-01-27 21:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC09499>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:54:44Z',
'fuel_type': 'petrol',
'id': 'bd1c7450-019d-5309-9bf8-573cd3362ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC09499',
'listing': 'auction',
'location': 'IT, Roma (RM)',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 24996,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Ultimate',
'transmission': 'manual',
'trim': 'Ultimate',
'year': 2023}
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC09499%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Saving data for YC09499: {'auction_closing_time': 1769619284.0, 'created_time': 1769457820.972846, 'last_price_update_time': 1769547705.115427}
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YC09499') HTTP/1.1" 204 0
2026-01-27 21:01:45 [auto1.it] INFO: Found listing with ID: TD65614
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD65614%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Scrape type for TD65614: 2
2026-01-27 21:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX57243/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV65430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT86640> (referer: https://www.auto1.com/v1/car-details-view/FT86640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP36812> (referer: https://www.auto1.com/v1/car-details-view/SP36812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML77651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:45 [auto1.it] INFO: Found listing with ID: TH12767
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Scrape type for TH12767: 0
2026-01-27 21:01:45 [auto1.it] INFO: Found listing with ID: VW18274
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW18274%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Scrape type for VW18274: 2
2026-01-27 21:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:45 [auto1.it] INFO: Found listing with ID: GY89378
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY89378%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Scrape type for GY89378: 2
2026-01-27 21:01:45 [auto1.it] INFO: Found listing with ID: HA18231
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA18231%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Scrape type for HA18231: 2
2026-01-27 21:01:45 [auto1.it] INFO: Found listing with ID: NC94766
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Scrape type for NC94766: 2
2026-01-27 21:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 with identifier: FT86640
2026-01-27 21:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0840f43a-a728-5a1b-8836-0726c34f1ca3 with scrape type 2
2026-01-27 21:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0840f43a-a728-5a1b-8836-0726c34f1ca3 with scrape type 2
2026-01-27 21:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0840f43a-a728-5a1b-8836-0726c34f1ca3, identifier: FT86640
2026-01-27 21:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812
2026-01-27 21:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb6246ac-b3e4-5237-a992-04851cc77fdc with scrape type 2
2026-01-27 21:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb6246ac-b3e4-5237-a992-04851cc77fdc with scrape type 2
2026-01-27 21:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb6246ac-b3e4-5237-a992-04851cc77fdc, identifier: SP36812
2026-01-27 21:01:45 [auto1.it] INFO: Found listing with ID: FG14287
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG14287%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Scrape type for FG14287: 2
2026-01-27 21:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 with identifier: FT86640
2026-01-27 21:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 with identifier: FT86640
2026-01-27 21:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154941 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154941
2026-01-27 21:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0840f43a-a728-5a1b-8836-0726c34f1ca3 spider: auto1.it
2026-01-27 21:01:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0840f43a-a728-5a1b-8836-0726c34f1ca3 due to rule: high_mileage_for_country.json, error: 154941 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154941
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-01-28T16:55:11Z',
'fuel_type': 'diesel',
'id': '0840f43a-a728-5a1b-8836-0726c34f1ca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT86640',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 154941,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.6 dCi Energy Hypnotic2',
'transmission': 'automatic',
'trim': 'Hypnotic2',
'year': 2018}
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT86640%27 HTTP/1.1" 200 None
2026-01-27 21:01:45 [auto1.it] INFO: Saving data for FT86640: {'auction_closing_time': 1769619311.0, 'created_time': 1768507450.314674, 'last_price_update_time': 1769547705.740435}
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT86640') HTTP/1.1" 204 0
2026-01-27 21:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812
2026-01-27 21:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812
2026-01-27 21:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb6246ac-b3e4-5237-a992-04851cc77fdc with identifier: SP36812 to the API
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SP36812>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 306,
'expiration_date': '2026-01-28T16:51:29Z',
'fuel_type': 'petrol',
'id': 'fb6246ac-b3e4-5237-a992-04851cc77fdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP36812',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 81561,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP36812%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Saving data for SP36812: {'auction_closing_time': 1769619089.0, 'created_time': 1769025642.799941, 'last_price_update_time': 1769547706.060038}
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP36812') HTTP/1.1" 204 0
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: EY68102
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY68102%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for EY68102: 0
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: XN08896
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN08896%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for XN08896: 2
2026-01-27 21:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE10991> (referer: https://www.auto1.com/v1/car-details-view/HE10991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN24419> (referer: https://www.auto1.com/v1/car-details-view/RN24419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL59630> (referer: https://www.auto1.com/v1/car-details-view/VL59630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: WN73794
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN73794%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for WN73794: 0
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: NX59013
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX59013%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for NX59013: 2
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: FG75193
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG75193%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for FG75193: 2
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: GH67198
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH67198%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for GH67198: 2
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: YG52761
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG52761%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for YG52761: 2
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: KV39330
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39330%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for KV39330: 2
2026-01-27 21:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb27a70-2826-56c5-861b-45ad967c3e68 with identifier: HE10991
2026-01-27 21:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb27a70-2826-56c5-861b-45ad967c3e68 with scrape type 2
2026-01-27 21:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccb27a70-2826-56c5-861b-45ad967c3e68 with scrape type 2
2026-01-27 21:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ccb27a70-2826-56c5-861b-45ad967c3e68, identifier: HE10991
2026-01-27 21:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-01-27 21:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 752208e0-483a-5ac1-b162-e4c16b7ab71c with scrape type 2
2026-01-27 21:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 752208e0-483a-5ac1-b162-e4c16b7ab71c with scrape type 2
2026-01-27 21:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 752208e0-483a-5ac1-b162-e4c16b7ab71c, identifier: RN24419
2026-01-27 21:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 909c1ed3-1c4e-5469-b6ea-9e67bb3746af with identifier: VL59630
2026-01-27 21:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 909c1ed3-1c4e-5469-b6ea-9e67bb3746af with scrape type 2
2026-01-27 21:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 909c1ed3-1c4e-5469-b6ea-9e67bb3746af with scrape type 2
2026-01-27 21:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 909c1ed3-1c4e-5469-b6ea-9e67bb3746af, identifier: VL59630
2026-01-27 21:01:46 [auto1.it] INFO: Found listing with ID: EG40810
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG40810%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Scrape type for EG40810: 2
2026-01-27 21:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ccb27a70-2826-56c5-861b-45ad967c3e68 with identifier: HE10991
2026-01-27 21:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ccb27a70-2826-56c5-861b-45ad967c3e68 with identifier: HE10991
2026-01-27 21:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130279 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130279
2026-01-27 21:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: ccb27a70-2826-56c5-861b-45ad967c3e68 spider: auto1.it
2026-01-27 21:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ccb27a70-2826-56c5-861b-45ad967c3e68 due to rule: high_mileage_for_make.json, error: 130279 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130279
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-01-28T16:33:41Z',
'fuel_type': 'diesel',
'id': 'ccb27a70-2826-56c5-861b-45ad967c3e68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE10991',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Peugeot',
'model': '508',
'odometer': 130279,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 2.0 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE10991%27 HTTP/1.1" 200 None
2026-01-27 21:01:46 [auto1.it] INFO: Saving data for HE10991: {'auction_closing_time': 1769618021.0, 'created_time': 1769457910.89927, 'last_price_update_time': 1769547706.772705}
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HE10991') HTTP/1.1" 204 0
2026-01-27 21:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-01-27 21:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-01-27 21:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419 to the API
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN24419>
{'auction_title': '',
'c_o_2_emission_value': 192,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 200,
'expiration_date': '2026-01-28T16:46:41Z',
'fuel_type': 'diesel',
'id': '752208e0-483a-5ac1-b162-e4c16b7ab71c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN24419',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 76562,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.2 CRDi Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2019}
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Saving data for RN24419: {'auction_closing_time': 1769618801.0, 'created_time': 1769458185.492975, 'last_price_update_time': 1769547707.214256}
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN24419') HTTP/1.1" 204 0
2026-01-27 21:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 909c1ed3-1c4e-5469-b6ea-9e67bb3746af with identifier: VL59630
2026-01-27 21:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 909c1ed3-1c4e-5469-b6ea-9e67bb3746af with identifier: VL59630
2026-01-27 21:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 909c1ed3-1c4e-5469-b6ea-9e67bb3746af with identifier: VL59630 to the API
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VL59630>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.5L',
'engine_horse_power': 218,
'expiration_date': '2026-01-28T16:07:54Z',
'fuel_type': 'hybrid',
'id': '909c1ed3-1c4e-5469-b6ea-9e67bb3746af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL59630',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 68004,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Style',
'transmission': 'automatic',
'trim': '4x2 Style',
'year': 2020}
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL59630%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Saving data for VL59630: {'auction_closing_time': 1769616474.0, 'created_time': 1768989806.549713, 'last_price_update_time': 1769547707.546319}
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL59630') HTTP/1.1" 204 0
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: GE60272
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE60272%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for GE60272: 0
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: AV71014
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV71014%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for AV71014: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: WB82138
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB82138%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for WB82138: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: BB49815
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB49815%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for BB49815: 0
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: XW65998
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW65998%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for XW65998: 0
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: AF20385
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF20385%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for AF20385: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: NJ84699
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ84699%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for NJ84699: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: EG37801
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for EG37801: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: VY49338
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY49338%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for VY49338: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: XT65171
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT65171%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for XT65171: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: JJ54173
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ54173%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for JJ54173: 0
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: DL88006
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL88006%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for DL88006: 2
2026-01-27 21:01:47 [auto1.it] INFO: Found listing with ID: PM77932
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77932%27 HTTP/1.1" 200 None
2026-01-27 21:01:47 [auto1.it] INFO: Scrape type for PM77932: 2
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX93740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR38482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW59498> (referer: https://www.auto1.com/v1/car-details-view/VW59498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE15341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX08238/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK01725/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7146f193-b15e-5cc2-96d0-ea03f7064843 with identifier: VW59498
2026-01-27 21:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7146f193-b15e-5cc2-96d0-ea03f7064843 with scrape type 2
2026-01-27 21:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7146f193-b15e-5cc2-96d0-ea03f7064843 with scrape type 2
2026-01-27 21:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7146f193-b15e-5cc2-96d0-ea03f7064843, identifier: VW59498
2026-01-27 21:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7146f193-b15e-5cc2-96d0-ea03f7064843 with identifier: VW59498
2026-01-27 21:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7146f193-b15e-5cc2-96d0-ea03f7064843 with identifier: VW59498
2026-01-27 21:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7146f193-b15e-5cc2-96d0-ea03f7064843 with identifier: VW59498 to the API
2026-01-27 21:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW59498>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-01-28T16:29:58Z',
'fuel_type': 'petrol',
'id': '7146f193-b15e-5cc2-96d0-ea03f7064843',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW59498',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Ford',
'model': 'Puma',
'odometer': 72129,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium Design',
'transmission': 'manual',
'trim': 'Titanium Design',
'year': 2022}
2026-01-27 21:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW59498%27 HTTP/1.1" 200 None
2026-01-27 21:01:48 [auto1.it] INFO: Saving data for VW59498: {'auction_closing_time': 1769617798.0, 'created_time': 1769458220.920634, 'last_price_update_time': 1769547708.851573}
2026-01-27 21:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VW59498') HTTP/1.1" 204 0
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH19679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL05088> (referer: https://www.auto1.com/v1/car-details-view/ZL05088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088
2026-01-27 21:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfca9ace-3a78-5143-90c6-6182600a8904 with scrape type 2
2026-01-27 21:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfca9ace-3a78-5143-90c6-6182600a8904 with scrape type 2
2026-01-27 21:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dfca9ace-3a78-5143-90c6-6182600a8904, identifier: ZL05088
2026-01-27 21:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088
2026-01-27 21:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088
2026-01-27 21:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dfca9ace-3a78-5143-90c6-6182600a8904 with identifier: ZL05088 to the API
2026-01-27 21:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL05088>
{'auction_title': '',
'c_o_2_emission_value': 224,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-01-28T16:15:06Z',
'fuel_type': 'diesel',
'id': 'dfca9ace-3a78-5143-90c6-6182600a8904',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL05088',
'listing': 'auction',
'location': 'Treviolo',
'make': 'GWM',
'model': 'H6',
'odometer': 43421,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'GWM H6 2.0 Turbodiesel One 2WD',
'transmission': 'manual',
'trim': 'One 2WD',
'year': 2022}
2026-01-27 21:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL05088%27 HTTP/1.1" 200 None
2026-01-27 21:01:49 [auto1.it] INFO: Saving data for ZL05088: {'auction_closing_time': 1769616906.0, 'created_time': 1769458130.996762, 'last_price_update_time': 1769547709.474912}
2026-01-27 21:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZL05088') HTTP/1.1" 204 0
2026-01-27 21:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD65614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP49742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ21424/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR13535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA44025> (referer: https://www.auto1.com/v1/car-details-view/DA44025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025
2026-01-27 21:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with scrape type 2
2026-01-27 21:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with scrape type 2
2026-01-27 21:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b, identifier: DA44025
2026-01-27 21:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025
2026-01-27 21:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025
2026-01-27 21:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e1e0932-9406-58e8-8abf-6f2f6099ba7b with identifier: DA44025 to the API
2026-01-27 21:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA44025>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 184,
'expiration_date': '2026-01-28T16:11:06Z',
'fuel_type': 'hybrid',
'id': '6e1e0932-9406-58e8-8abf-6f2f6099ba7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA44025',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Lexus',
'model': 'UX-Serie',
'odometer': 68128,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-21',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus UX-Serie UX 250h Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-01-27 21:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44025%27 HTTP/1.1" 200 None
2026-01-27 21:01:50 [auto1.it] INFO: Saving data for DA44025: {'auction_closing_time': 1769616666.0, 'created_time': 1769458080.471993, 'last_price_update_time': 1769547710.801406}
2026-01-27 21:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA44025') HTTP/1.1" 204 0
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG14287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV65430> (referer: https://www.auto1.com/v1/car-details-view/AV65430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML77651> (referer: https://www.auto1.com/v1/car-details-view/ML77651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM77932/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f11b9f-3756-538f-9685-0f5cdca5959a with identifier: AV65430
2026-01-27 21:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f11b9f-3756-538f-9685-0f5cdca5959a with scrape type 2
2026-01-27 21:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50f11b9f-3756-538f-9685-0f5cdca5959a with scrape type 2
2026-01-27 21:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50f11b9f-3756-538f-9685-0f5cdca5959a, identifier: AV65430
2026-01-27 21:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50f11b9f-3756-538f-9685-0f5cdca5959a with identifier: AV65430
2026-01-27 21:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50f11b9f-3756-538f-9685-0f5cdca5959a with identifier: AV65430
2026-01-27 21:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173023 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173023
2026-01-27 21:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 50f11b9f-3756-538f-9685-0f5cdca5959a spider: auto1.it
2026-01-27 21:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 50f11b9f-3756-538f-9685-0f5cdca5959a due to rule: high_mileage_for_country.json, error: 173023 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173023
{'auction_title': '',
'c_o_2_emission_value': 183,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-01-28T16:09:55Z',
'fuel_type': 'diesel',
'id': '50f11b9f-3756-538f-9685-0f5cdca5959a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV65430',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'make': 'BMW',
'model': 'X6',
'odometer': 173023,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X6 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV65430%27 HTTP/1.1" 200 None
2026-01-27 21:01:51 [auto1.it] INFO: Saving data for AV65430: {'auction_closing_time': 1769616595.0, 'created_time': 1769025645.165519, 'last_price_update_time': 1769547711.276625}
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AV65430') HTTP/1.1" 204 0
2026-01-27 21:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL88006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT65171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651
2026-01-27 21:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with scrape type 2
2026-01-27 21:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with scrape type 2
2026-01-27 21:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59, identifier: ML77651
2026-01-27 21:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651
2026-01-27 21:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651
2026-01-27 21:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59 with identifier: ML77651 to the API
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML77651>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:22:24Z',
'fuel_type': 'petrol',
'id': 'c47af3b8-d050-55ee-9c9f-a3aa3a9f0f59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML77651',
'listing': 'auction',
'location': 'IT, Como',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 42574,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML77651%27 HTTP/1.1" 200 None
2026-01-27 21:01:51 [auto1.it] INFO: Saving data for ML77651: {'auction_closing_time': 1769617344.0, 'created_time': 1769458347.945427, 'last_price_update_time': 1769547711.767849}
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML77651') HTTP/1.1" 204 0
2026-01-27 21:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY49338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG37801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ84699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR38482> (referer: https://www.auto1.com/v1/car-details-view/GR38482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE15341> (referer: https://www.auto1.com/v1/car-details-view/KE15341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH19679> (referer: https://www.auto1.com/v1/car-details-view/ZH19679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482
2026-01-27 21:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5026cd67-a342-5243-852c-db4d262c50ea with scrape type 2
2026-01-27 21:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5026cd67-a342-5243-852c-db4d262c50ea with scrape type 2
2026-01-27 21:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5026cd67-a342-5243-852c-db4d262c50ea, identifier: GR38482
2026-01-27 21:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482
2026-01-27 21:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-27 21:01:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-01-27 21:01:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 21:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-27 21:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482
2026-01-27 21:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482 to the API
2026-01-27 21:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR38482>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:22:06Z',
'fuel_type': 'diesel',
'id': '5026cd67-a342-5243-852c-db4d262c50ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR38482',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 88008,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR38482%27 HTTP/1.1" 200 None
2026-01-27 21:01:53 [auto1.it] INFO: Saving data for GR38482: {'auction_closing_time': 1769617326.0, 'created_time': 1769076401.579665, 'last_price_update_time': 1769547713.200853}
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR38482') HTTP/1.1" 204 0
2026-01-27 21:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK01725> (referer: https://www.auto1.com/v1/car-details-view/LK01725/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ21424> (referer: https://www.auto1.com/v1/car-details-view/KZ21424/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD65614> (referer: https://www.auto1.com/v1/car-details-view/TD65614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR13535> (referer: https://www.auto1.com/v1/car-details-view/BR13535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX08238> (referer: https://www.auto1.com/v1/car-details-view/PX08238/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a127559-c13a-5cd8-a933-2d2a2fa494a1 with identifier: KE15341
2026-01-27 21:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a127559-c13a-5cd8-a933-2d2a2fa494a1 with scrape type 2
2026-01-27 21:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a127559-c13a-5cd8-a933-2d2a2fa494a1 with scrape type 2
2026-01-27 21:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a127559-c13a-5cd8-a933-2d2a2fa494a1, identifier: KE15341
2026-01-27 21:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fafc426-ec1d-57a3-8a3b-1edd165aebc5 with identifier: ZH19679
2026-01-27 21:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fafc426-ec1d-57a3-8a3b-1edd165aebc5 with scrape type 2
2026-01-27 21:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fafc426-ec1d-57a3-8a3b-1edd165aebc5 with scrape type 2
2026-01-27 21:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8fafc426-ec1d-57a3-8a3b-1edd165aebc5, identifier: ZH19679
2026-01-27 21:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a127559-c13a-5cd8-a933-2d2a2fa494a1 with identifier: KE15341
2026-01-27 21:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a127559-c13a-5cd8-a933-2d2a2fa494a1 with identifier: KE15341
2026-01-27 21:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a127559-c13a-5cd8-a933-2d2a2fa494a1 with identifier: KE15341 to the API
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE15341>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': 'Rental',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2026-01-28T16:30:39Z',
'fuel_type': 'hybrid',
'id': '3a127559-c13a-5cd8-a933-2d2a2fa494a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE15341',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 39904,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Corolla 1.8 Hybrid Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2021}
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE15341%27 HTTP/1.1" 200 None
2026-01-27 21:01:53 [auto1.it] INFO: Saving data for KE15341: {'auction_closing_time': 1769617839.0, 'created_time': 1769458031.639088, 'last_price_update_time': 1769547713.757013}
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE15341') HTTP/1.1" 204 0
2026-01-27 21:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8fafc426-ec1d-57a3-8a3b-1edd165aebc5 with identifier: ZH19679
2026-01-27 21:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8fafc426-ec1d-57a3-8a3b-1edd165aebc5 with identifier: ZH19679
2026-01-27 21:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8fafc426-ec1d-57a3-8a3b-1edd165aebc5 with identifier: ZH19679 to the API
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH19679>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:40:22Z',
'fuel_type': 'petrol',
'id': '8fafc426-ec1d-57a3-8a3b-1edd165aebc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH19679',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 70923,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2019}
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH19679%27 HTTP/1.1" 200 None
2026-01-27 21:01:54 [auto1.it] INFO: Saving data for ZH19679: {'auction_closing_time': 1769618422.0, 'created_time': 1769457901.622394, 'last_price_update_time': 1769547714.062111}
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH19679') HTTP/1.1" 204 0
2026-01-27 21:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: babfea18-0f9e-5abd-8aac-b37386cc1439 with identifier: LK01725
2026-01-27 21:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item babfea18-0f9e-5abd-8aac-b37386cc1439 with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item babfea18-0f9e-5abd-8aac-b37386cc1439 with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: babfea18-0f9e-5abd-8aac-b37386cc1439, identifier: LK01725
2026-01-27 21:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6991082-0a54-5a83-b22c-6a1e01404461 with identifier: KZ21424
2026-01-27 21:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6991082-0a54-5a83-b22c-6a1e01404461 with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6991082-0a54-5a83-b22c-6a1e01404461 with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6991082-0a54-5a83-b22c-6a1e01404461, identifier: KZ21424
2026-01-27 21:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f4e208b-23b7-586e-9eeb-e924ef3bd2e8 with identifier: TD65614
2026-01-27 21:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f4e208b-23b7-586e-9eeb-e924ef3bd2e8 with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f4e208b-23b7-586e-9eeb-e924ef3bd2e8 with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f4e208b-23b7-586e-9eeb-e924ef3bd2e8, identifier: TD65614
2026-01-27 21:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de0d17c7-6084-53b7-9f80-bf3acae0c4bf with identifier: BR13535
2026-01-27 21:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de0d17c7-6084-53b7-9f80-bf3acae0c4bf with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de0d17c7-6084-53b7-9f80-bf3acae0c4bf with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de0d17c7-6084-53b7-9f80-bf3acae0c4bf, identifier: BR13535
2026-01-27 21:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca3e8de-afa8-5e96-abda-63e9cce3048c with identifier: PX08238
2026-01-27 21:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca3e8de-afa8-5e96-abda-63e9cce3048c with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eca3e8de-afa8-5e96-abda-63e9cce3048c with scrape type 2
2026-01-27 21:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eca3e8de-afa8-5e96-abda-63e9cce3048c, identifier: PX08238
2026-01-27 21:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: babfea18-0f9e-5abd-8aac-b37386cc1439 with identifier: LK01725
2026-01-27 21:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: babfea18-0f9e-5abd-8aac-b37386cc1439 with identifier: LK01725
2026-01-27 21:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191401 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191401
2026-01-27 21:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: babfea18-0f9e-5abd-8aac-b37386cc1439 spider: auto1.it
2026-01-27 21:01:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: babfea18-0f9e-5abd-8aac-b37386cc1439 due to rule: high_mileage_for_country.json, error: 191401 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191401
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.4L',
'engine_horse_power': 100,
'expiration_date': '2026-01-28T16:45:17Z',
'fuel_type': 'petrol',
'id': 'babfea18-0f9e-5abd-8aac-b37386cc1439',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK01725',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Kia',
'model': 'Stonic',
'odometer': 191401,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.4 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2020}
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK01725%27 HTTP/1.1" 200 None
2026-01-27 21:01:54 [auto1.it] INFO: Saving data for LK01725: {'auction_closing_time': 1769618717.0, 'created_time': 1769457857.14599, 'last_price_update_time': 1769547714.879162}
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LK01725') HTTP/1.1" 204 0
2026-01-27 21:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6991082-0a54-5a83-b22c-6a1e01404461 with identifier: KZ21424
2026-01-27 21:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6991082-0a54-5a83-b22c-6a1e01404461 with identifier: KZ21424
2026-01-27 21:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6991082-0a54-5a83-b22c-6a1e01404461 with identifier: KZ21424 to the API
2026-01-27 21:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ21424>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:30:17Z',
'fuel_type': 'petrol',
'id': 'a6991082-0a54-5a83-b22c-6a1e01404461',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ21424',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Kia',
'model': 'Stonic',
'odometer': 99687,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Energy',
'transmission': 'manual',
'trim': 'Energy',
'year': 2019}
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ21424%27 HTTP/1.1" 200 None
2026-01-27 21:01:55 [auto1.it] INFO: Saving data for KZ21424: {'auction_closing_time': 1769617817.0, 'created_time': 1769457844.29153, 'last_price_update_time': 1769547715.199627}
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ21424') HTTP/1.1" 204 0
2026-01-27 21:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f4e208b-23b7-586e-9eeb-e924ef3bd2e8 with identifier: TD65614
2026-01-27 21:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f4e208b-23b7-586e-9eeb-e924ef3bd2e8 with identifier: TD65614
2026-01-27 21:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f4e208b-23b7-586e-9eeb-e924ef3bd2e8 with identifier: TD65614 to the API
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TD65614>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-01-28T16:04:21Z',
'fuel_type': 'diesel',
'id': '4f4e208b-23b7-586e-9eeb-e924ef3bd2e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD65614',
'listing': 'auction',
'location': 'IT, CASEI GEROLA',
'make': 'Peugeot',
'model': '2008',
'odometer': 129727,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2020}
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD65614%27 HTTP/1.1" 200 None
2026-01-27 21:01:55 [auto1.it] INFO: Saving data for TD65614: {'auction_closing_time': 1769616261.0, 'created_time': 1769458452.046523, 'last_price_update_time': 1769547715.505327}
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD65614') HTTP/1.1" 204 0
2026-01-27 21:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de0d17c7-6084-53b7-9f80-bf3acae0c4bf with identifier: BR13535
2026-01-27 21:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de0d17c7-6084-53b7-9f80-bf3acae0c4bf with identifier: BR13535
2026-01-27 21:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192196 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
192196
2026-01-27 21:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: de0d17c7-6084-53b7-9f80-bf3acae0c4bf spider: auto1.it
2026-01-27 21:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: de0d17c7-6084-53b7-9f80-bf3acae0c4bf due to rule: high_mileage_for_country.json, error: 192196 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
192196
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:08:02Z',
'fuel_type': 'diesel',
'id': 'de0d17c7-6084-53b7-9f80-bf3acae0c4bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR13535',
'listing': 'auction',
'location': 'IT, Creazzo VI',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 192196,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi S-Edition',
'transmission': 'manual',
'trim': 'S-Edition',
'year': 2019}
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR13535%27 HTTP/1.1" 200 None
2026-01-27 21:01:55 [auto1.it] INFO: Saving data for BR13535: {'auction_closing_time': 1769616482.0, 'created_time': 1769458450.44477, 'last_price_update_time': 1769547715.727063}
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BR13535') HTTP/1.1" 204 0
2026-01-27 21:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eca3e8de-afa8-5e96-abda-63e9cce3048c with identifier: PX08238
2026-01-27 21:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eca3e8de-afa8-5e96-abda-63e9cce3048c with identifier: PX08238
2026-01-27 21:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eca3e8de-afa8-5e96-abda-63e9cce3048c with identifier: PX08238 to the API
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX08238>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:21:22Z',
'fuel_type': 'petrol',
'id': 'eca3e8de-afa8-5e96-abda-63e9cce3048c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX08238',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Ford',
'model': 'Kuga',
'odometer': 31147,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2023}
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX08238%27 HTTP/1.1" 200 None
2026-01-27 21:01:56 [auto1.it] INFO: Saving data for PX08238: {'auction_closing_time': 1769617282.0, 'created_time': 1768557746.177252, 'last_price_update_time': 1769547716.056297}
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PX08238') HTTP/1.1" 204 0
2026-01-27 21:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP49742> (referer: https://www.auto1.com/v1/car-details-view/LP49742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX93740> (referer: https://www.auto1.com/v1/car-details-view/LX93740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF20385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7acdc2-faac-58ed-a47d-564baed0f490 with identifier: LP49742
2026-01-27 21:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7acdc2-faac-58ed-a47d-564baed0f490 with scrape type 2
2026-01-27 21:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b7acdc2-faac-58ed-a47d-564baed0f490 with scrape type 2
2026-01-27 21:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b7acdc2-faac-58ed-a47d-564baed0f490, identifier: LP49742
2026-01-27 21:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b7acdc2-faac-58ed-a47d-564baed0f490 with identifier: LP49742
2026-01-27 21:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b7acdc2-faac-58ed-a47d-564baed0f490 with identifier: LP49742
2026-01-27 21:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-27 21:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8b7acdc2-faac-58ed-a47d-564baed0f490 spider: auto1.it
2026-01-27 21:01:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8b7acdc2-faac-58ed-a47d-564baed0f490 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:40:54Z',
'fuel_type': 'diesel',
'id': '8b7acdc2-faac-58ed-a47d-564baed0f490',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP49742',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 139617,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
'transmission': 'manual',
'trim': 'Allure L2',
'year': 2018}
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP49742%27 HTTP/1.1" 200 None
2026-01-27 21:01:56 [auto1.it] INFO: Saving data for LP49742: {'auction_closing_time': 1769618454.0, 'created_time': 1769457856.613482, 'last_price_update_time': 1769547716.556834}
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LP49742') HTTP/1.1" 204 0
2026-01-27 21:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740
2026-01-27 21:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with scrape type 2
2026-01-27 21:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with scrape type 2
2026-01-27 21:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6, identifier: LX93740
2026-01-27 21:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740
2026-01-27 21:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740
2026-01-27 21:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb76ab51-6a3a-5d50-a0a0-a6d3844844a6 with identifier: LX93740 to the API
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX93740>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:35:08Z',
'fuel_type': 'diesel',
'id': 'bb76ab51-6a3a-5d50-a0a0-a6d3844844a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX93740',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 39856,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93740%27 HTTP/1.1" 200 None
2026-01-27 21:01:57 [auto1.it] INFO: Saving data for LX93740: {'auction_closing_time': 1769618108.0, 'created_time': 1769026047.098028, 'last_price_update_time': 1769547717.03594}
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX93740') HTTP/1.1" 204 0
2026-01-27 21:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB82138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG37801> (referer: https://www.auto1.com/v1/car-details-view/EG37801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG14287> (referer: https://www.auto1.com/v1/car-details-view/FG14287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM77932> (referer: https://www.auto1.com/v1/car-details-view/PM77932/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY49338> (referer: https://www.auto1.com/v1/car-details-view/VY49338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-01-27 21:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870e78e5-ab23-51a8-82b1-d23cd94548cb with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 870e78e5-ab23-51a8-82b1-d23cd94548cb with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 870e78e5-ab23-51a8-82b1-d23cd94548cb, identifier: EG37801
2026-01-27 21:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with identifier: FG14287
2026-01-27 21:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d, identifier: FG14287
2026-01-27 21:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681493a3-805c-5b9f-883b-9aa64fd11a11 with identifier: PM77932
2026-01-27 21:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681493a3-805c-5b9f-883b-9aa64fd11a11 with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681493a3-805c-5b9f-883b-9aa64fd11a11 with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 681493a3-805c-5b9f-883b-9aa64fd11a11, identifier: PM77932
2026-01-27 21:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338
2026-01-27 21:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ee123f-68d8-5be3-b187-f7667e024346 with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ee123f-68d8-5be3-b187-f7667e024346 with scrape type 2
2026-01-27 21:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 08ee123f-68d8-5be3-b187-f7667e024346, identifier: VY49338
2026-01-27 21:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-01-27 21:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-01-27 21:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801 to the API
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG37801>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:31:12Z',
'fuel_type': 'petrol',
'id': '870e78e5-ab23-51a8-82b1-d23cd94548cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG37801',
'listing': 'auction',
'location': 'Camerano (AN)',
'make': 'DR',
'model': 'DR 3',
'odometer': 70363,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 3 1.5',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-01-27 21:01:57 [auto1.it] INFO: Saving data for EG37801: {'auction_closing_time': 1769617872.0, 'created_time': 1769458280.277102, 'last_price_update_time': 1769547717.880454}
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG37801') HTTP/1.1" 204 0
2026-01-27 21:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with identifier: FG14287
2026-01-27 21:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d with identifier: FG14287
2026-01-27 21:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178986 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178986
2026-01-27 21:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d spider: auto1.it
2026-01-27 21:01:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d due to rule: high_mileage_for_country.json, error: 178986 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178986
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-01-28T16:53:38Z',
'fuel_type': 'diesel',
'id': '5d427e20-fbcc-5fea-a8ce-03b95a4f7a3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG14287',
'listing': 'auction',
'location': 'IT, Foggia',
'make': 'Volvo',
'model': 'XC60',
'odometer': 178986,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Plus Dark AWD',
'transmission': 'automatic',
'trim': 'Plus Dark AWD',
'year': 2023}
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG14287%27 HTTP/1.1" 200 None
2026-01-27 21:01:58 [auto1.it] INFO: Saving data for FG14287: {'auction_closing_time': 1769619218.0, 'created_time': 1769458279.69382, 'last_price_update_time': 1769547718.139595}
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FG14287') HTTP/1.1" 204 0
2026-01-27 21:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 681493a3-805c-5b9f-883b-9aa64fd11a11 with identifier: PM77932
2026-01-27 21:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 681493a3-805c-5b9f-883b-9aa64fd11a11 with identifier: PM77932
2026-01-27 21:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 681493a3-805c-5b9f-883b-9aa64fd11a11 with identifier: PM77932 to the API
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM77932>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:20:42Z',
'fuel_type': 'petrol',
'id': '681493a3-805c-5b9f-883b-9aa64fd11a11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM77932',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 44434,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77932%27 HTTP/1.1" 200 None
2026-01-27 21:01:58 [auto1.it] INFO: Saving data for PM77932: {'auction_closing_time': 1769617242.0, 'created_time': 1769458012.371773, 'last_price_update_time': 1769547718.46009}
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM77932') HTTP/1.1" 204 0
2026-01-27 21:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338
2026-01-27 21:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338
2026-01-27 21:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 08ee123f-68d8-5be3-b187-f7667e024346 with identifier: VY49338 to the API
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VY49338>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2026-01-28T16:24:56Z',
'fuel_type': 'hybrid',
'id': '08ee123f-68d8-5be3-b187-f7667e024346',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY49338',
'listing': 'auction',
'location': 'IT, Roma (RM)',
'make': 'Renault',
'model': 'Captur',
'odometer': 60675,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2022}
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY49338%27 HTTP/1.1" 200 None
2026-01-27 21:01:58 [auto1.it] INFO: Saving data for VY49338: {'auction_closing_time': 1769617496.0, 'created_time': 1769458343.106823, 'last_price_update_time': 1769547718.788135}
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY49338') HTTP/1.1" 204 0
2026-01-27 21:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ84699> (referer: https://www.auto1.com/v1/car-details-view/NJ84699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT65171> (referer: https://www.auto1.com/v1/car-details-view/XT65171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL88006> (referer: https://www.auto1.com/v1/car-details-view/DL88006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9adfb270-197d-5237-9c42-d221d5edb9ca with identifier: NJ84699
2026-01-27 21:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9adfb270-197d-5237-9c42-d221d5edb9ca with scrape type 2
2026-01-27 21:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9adfb270-197d-5237-9c42-d221d5edb9ca with scrape type 2
2026-01-27 21:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9adfb270-197d-5237-9c42-d221d5edb9ca, identifier: NJ84699
2026-01-27 21:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9adfb270-197d-5237-9c42-d221d5edb9ca with identifier: NJ84699
2026-01-27 21:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9adfb270-197d-5237-9c42-d221d5edb9ca with identifier: NJ84699
2026-01-27 21:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9adfb270-197d-5237-9c42-d221d5edb9ca with identifier: NJ84699 to the API
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NJ84699>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:41:41Z',
'fuel_type': 'petrol',
'id': '9adfb270-197d-5237-9c42-d221d5edb9ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ84699',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Renault',
'model': 'Clio',
'odometer': 87215,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2020}
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ84699%27 HTTP/1.1" 200 None
2026-01-27 21:01:59 [auto1.it] INFO: Saving data for NJ84699: {'auction_closing_time': 1769618501.0, 'created_time': 1769458155.848298, 'last_price_update_time': 1769547719.31412}
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NJ84699') HTTP/1.1" 204 0
2026-01-27 21:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67b60ae6-3d58-5615-b988-20cfebaaccb6 with identifier: XT65171
2026-01-27 21:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b60ae6-3d58-5615-b988-20cfebaaccb6 with scrape type 2
2026-01-27 21:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67b60ae6-3d58-5615-b988-20cfebaaccb6 with scrape type 2
2026-01-27 21:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67b60ae6-3d58-5615-b988-20cfebaaccb6, identifier: XT65171
2026-01-27 21:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006
2026-01-27 21:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd2782f-ddfb-5a20-99b3-f363c0695802 with scrape type 2
2026-01-27 21:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dd2782f-ddfb-5a20-99b3-f363c0695802 with scrape type 2
2026-01-27 21:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6dd2782f-ddfb-5a20-99b3-f363c0695802, identifier: DL88006
2026-01-27 21:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67b60ae6-3d58-5615-b988-20cfebaaccb6 with identifier: XT65171
2026-01-27 21:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67b60ae6-3d58-5615-b988-20cfebaaccb6 with identifier: XT65171
2026-01-27 21:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67b60ae6-3d58-5615-b988-20cfebaaccb6 with identifier: XT65171 to the API
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT65171>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:09:00Z',
'fuel_type': 'petrol',
'id': '67b60ae6-3d58-5615-b988-20cfebaaccb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT65171',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': '500X',
'odometer': 64717,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.0 Turbo Cross',
'transmission': 'manual',
'trim': 'Cross',
'year': 2019}
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT65171%27 HTTP/1.1" 200 None
2026-01-27 21:01:59 [auto1.it] INFO: Saving data for XT65171: {'auction_closing_time': 1769616540.0, 'created_time': 1769458174.593267, 'last_price_update_time': 1769547719.833178}
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT65171') HTTP/1.1" 204 0
2026-01-27 21:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006
2026-01-27 21:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006
2026-01-27 21:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6dd2782f-ddfb-5a20-99b3-f363c0695802 with identifier: DL88006 to the API
2026-01-27 21:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DL88006>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:31:01Z',
'fuel_type': 'petrol',
'id': '6dd2782f-ddfb-5a20-99b3-f363c0695802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL88006',
'listing': 'auction',
'location': 'Genova',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 45447,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-01-27 21:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL88006%27 HTTP/1.1" 200 None
2026-01-27 21:02:00 [auto1.it] INFO: Saving data for DL88006: {'auction_closing_time': 1769617861.0, 'created_time': 1769457896.622277, 'last_price_update_time': 1769547720.231056}
2026-01-27 21:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DL88006') HTTP/1.1" 204 0
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV71014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG40810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH67198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV39330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG52761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX59013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG75193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN08896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA18231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY89378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF20385> (referer: https://www.auto1.com/v1/car-details-view/AF20385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX57243> (referer: https://www.auto1.com/v1/car-details-view/VX57243/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385
2026-01-27 21:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5047b41-8d91-5f22-9388-a0f0732cf675 with scrape type 2
2026-01-27 21:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5047b41-8d91-5f22-9388-a0f0732cf675 with scrape type 2
2026-01-27 21:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5047b41-8d91-5f22-9388-a0f0732cf675, identifier: AF20385
2026-01-27 21:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385
2026-01-27 21:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385
2026-01-27 21:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385 to the API
2026-01-27 21:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF20385>
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 114,
'expiration_date': '2026-01-28T16:05:25Z',
'fuel_type': 'petrol',
'id': 'a5047b41-8d91-5f22-9388-a0f0732cf675',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF20385',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'make': 'EVO',
'model': '4',
'odometer': 28797,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'EVO 4 1.6',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-01-27 21:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF20385%27 HTTP/1.1" 200 None
2026-01-27 21:02:01 [auto1.it] INFO: Saving data for AF20385: {'auction_closing_time': 1769616325.0, 'created_time': 1769458210.810576, 'last_price_update_time': 1769547721.76484}
2026-01-27 21:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF20385') HTTP/1.1" 204 0
2026-01-27 21:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC94766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW18274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b with identifier: VX57243
2026-01-27 21:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b with scrape type 2
2026-01-27 21:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b with scrape type 2
2026-01-27 21:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b, identifier: VX57243
2026-01-27 21:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b with identifier: VX57243
2026-01-27 21:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b with identifier: VX57243
2026-01-27 21:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b with identifier: VX57243 to the API
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX57243>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 265,
'expiration_date': '2026-01-28T16:25:14Z',
'fuel_type': 'hybrid',
'id': '28e4f3d7-6d6e-5293-8b77-fd96a5df7b8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX57243',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 51116,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Exellence 4WD',
'transmission': 'automatic',
'trim': 'Exellence 4WD',
'year': 2022}
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX57243%27 HTTP/1.1" 200 None
2026-01-27 21:02:02 [auto1.it] INFO: Saving data for VX57243: {'auction_closing_time': 1769617514.0, 'created_time': 1768557710.856165, 'last_price_update_time': 1769547722.227026}
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VX57243') HTTP/1.1" 204 0
2026-01-27 21:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB82138> (referer: https://www.auto1.com/v1/car-details-view/WB82138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN16265/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF46047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138
2026-01-27 21:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with scrape type 2
2026-01-27 21:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with scrape type 2
2026-01-27 21:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0, identifier: WB82138
2026-01-27 21:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138
2026-01-27 21:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138
2026-01-27 21:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0 with identifier: WB82138 to the API
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB82138>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:34:15Z',
'fuel_type': 'petrol',
'id': 'b9e599ff-34ac-52e3-8dd3-bcfb254ad6a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB82138',
'listing': 'auction',
'location': 'IT, Foggia',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 113532,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-16',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
'transmission': 'automatic',
'trim': 'ACT',
'year': 2021}
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB82138%27 HTTP/1.1" 200 None
2026-01-27 21:02:02 [auto1.it] INFO: Saving data for WB82138: {'auction_closing_time': 1769618055.0, 'created_time': 1769458476.297913, 'last_price_update_time': 1769547722.784864}
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WB82138') HTTP/1.1" 204 0
2026-01-27 21:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH04520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY06074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:03 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: MR32652
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR32652%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for MR32652: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: RN67455
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN67455%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for RN67455: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: YL53737
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for YL53737: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: PS84479
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for PS84479: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: UM80859
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM80859%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for UM80859: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: JF49505
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF49505%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for JF49505: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: JS38459
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS38459%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for JS38459: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: EA57164
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA57164%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for EA57164: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: RD39232
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD39232%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for RD39232: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: EJ52499
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52499%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for EJ52499: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: UY66715
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY66715%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for UY66715: 0
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: MW43217
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW43217%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for MW43217: 0
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: NR13454
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR13454%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for NR13454: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: YN54929
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN54929%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for YN54929: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: KE68041
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE68041%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for KE68041: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: GJ74171
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ74171%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for GJ74171: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: RD72134
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD72134%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for RD72134: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: TY16780
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY16780%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for TY16780: 0
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: FT72404
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT72404%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for FT72404: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: EN58298
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN58298%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for EN58298: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: JP28374
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP28374%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for JP28374: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: NP55119
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP55119%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for NP55119: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: FU93011
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU93011%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for FU93011: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: DA86782
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA86782%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for DA86782: 0
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: SL36672
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL36672%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for SL36672: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: YF34887
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF34887%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for YF34887: 0
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: UA81726
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for UA81726: 2
2026-01-27 21:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG52761> (referer: https://www.auto1.com/v1/car-details-view/YG52761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: BY98220
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY98220%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for BY98220: 2
2026-01-27 21:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT57275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: XL30417
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL30417%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for XL30417: 2
2026-01-27 21:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: RN18613
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN18613%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for RN18613: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: JH21247
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH21247%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for JH21247: 2
2026-01-27 21:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV39330> (referer: https://www.auto1.com/v1/car-details-view/KV39330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: AY21953
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21953%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for AY21953: 2
2026-01-27 21:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: FR46544
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR46544%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for FR46544: 0
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: UL75822
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL75822%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for UL75822: 2
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: UU21154
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU21154%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for UU21154: 2
2026-01-27 21:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX59013> (referer: https://www.auto1.com/v1/car-details-view/NX59013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eebe4ea-4659-56cb-aafc-ba6a504ab17b with identifier: YG52761
2026-01-27 21:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eebe4ea-4659-56cb-aafc-ba6a504ab17b with scrape type 2
2026-01-27 21:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eebe4ea-4659-56cb-aafc-ba6a504ab17b with scrape type 2
2026-01-27 21:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5eebe4ea-4659-56cb-aafc-ba6a504ab17b, identifier: YG52761
2026-01-27 21:02:03 [auto1.it] INFO: Found listing with ID: ZB40645
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB40645%27 HTTP/1.1" 200 None
2026-01-27 21:02:03 [auto1.it] INFO: Scrape type for ZB40645: 2
2026-01-27 21:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5eebe4ea-4659-56cb-aafc-ba6a504ab17b with identifier: YG52761
2026-01-27 21:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5eebe4ea-4659-56cb-aafc-ba6a504ab17b with identifier: YG52761
2026-01-27 21:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati grecale 2.0 turbo mild-hybrid modena awd', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'grecale', 'transmission': 'automatic', 'odometer': 35090, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg52761', 'expiration_date': '2026-01-28t16:37:33z', 'origin_country_code': 'it', 'trim': 'modena awd', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 330, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '2.0l', 'location': 'it, milazzo', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d', 'c_o_2_emission_value': 209, 'id': '5eebe4ea-4659-56cb-aafc-ba6a504ab17b', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'maserati grecale', 'sanitized_make': 'maserati', 'odometer_in_km': 35090}
Failed validating None in schema:
False
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': 209,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6d',
'engine': '2.0l',
'engine_horse_power': 330,
'expiration_date': '2026-01-28t16:37:33z',
'fuel_type': 'petrol',
'id': '5eebe4ea-4659-56cb-aafc-ba6a504ab17b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg52761',
'listing': 'auction',
'location': 'it, milazzo',
'make': 'maserati',
'make_model': 'maserati grecale',
'model': 'grecale',
'odometer': 35090,
'odometer_in_km': 35090,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-19',
'sanitized_make': 'maserati',
'seats_number': 5,
'seller_name': None,
'title': 'maserati grecale 2.0 turbo mild-hybrid modena awd',
'transmission': 'automatic',
'trim': 'modena awd',
'year': 2022}
2026-01-27 21:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 5eebe4ea-4659-56cb-aafc-ba6a504ab17b spider: auto1.it
2026-01-27 21:02:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5eebe4ea-4659-56cb-aafc-ba6a504ab17b due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati grecale 2.0 turbo mild-hybrid modena awd', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'grecale', 'transmission': 'automatic', 'odometer': 35090, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg52761', 'expiration_date': '2026-01-28t16:37:33z', 'origin_country_code': 'it', 'trim': 'modena awd', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 330, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '2.0l', 'location': 'it, milazzo', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d', 'c_o_2_emission_value': 209, 'id': '5eebe4ea-4659-56cb-aafc-ba6a504ab17b', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'maserati grecale', 'sanitized_make': 'maserati', 'odometer_in_km': 35090}
Failed validating None in schema:
False
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': 209,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6d',
'engine': '2.0l',
'engine_horse_power': 330,
'expiration_date': '2026-01-28t16:37:33z',
'fuel_type': 'petrol',
'id': '5eebe4ea-4659-56cb-aafc-ba6a504ab17b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg52761',
'listing': 'auction',
'location': 'it, milazzo',
'make': 'maserati',
'make_model': 'maserati grecale',
'model': 'grecale',
'odometer': 35090,
'odometer_in_km': 35090,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-19',
'sanitized_make': 'maserati',
'seats_number': 5,
'seller_name': None,
'title': 'maserati grecale 2.0 turbo mild-hybrid modena awd',
'transmission': 'automatic',
'trim': 'modena awd',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 209,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 330,
'expiration_date': '2026-01-28T16:37:33Z',
'fuel_type': 'petrol',
'id': '5eebe4ea-4659-56cb-aafc-ba6a504ab17b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG52761',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Maserati',
'model': 'Grecale',
'odometer': 35090,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'Maserati Grecale 2.0 Turbo Mild-Hybrid Modena AWD',
'transmission': 'automatic',
'trim': 'Modena AWD',
'year': 2022}
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG52761%27 HTTP/1.1" 200 None
2026-01-27 21:02:04 [auto1.it] INFO: Saving data for YG52761: {'auction_closing_time': 1769618253.0, 'created_time': 1769198810.112687, 'last_price_update_time': 1769547724.117519}
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG52761') HTTP/1.1" 204 0
2026-01-27 21:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH67198> (referer: https://www.auto1.com/v1/car-details-view/GH67198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:04 [auto1.it] INFO: Found listing with ID: ZX13232
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX13232%27 HTTP/1.1" 200 None
2026-01-27 21:02:04 [auto1.it] INFO: Scrape type for ZX13232: 2
2026-01-27 21:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA18231> (referer: https://www.auto1.com/v1/car-details-view/HA18231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG75193> (referer: https://www.auto1.com/v1/car-details-view/FG75193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN08896> (referer: https://www.auto1.com/v1/car-details-view/XN08896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330
2026-01-27 21:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c5fc905-c2ee-5ccc-a62a-23438572850d with scrape type 2
2026-01-27 21:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c5fc905-c2ee-5ccc-a62a-23438572850d with scrape type 2
2026-01-27 21:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0c5fc905-c2ee-5ccc-a62a-23438572850d, identifier: KV39330
2026-01-27 21:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013
2026-01-27 21:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bcaf00-9213-546a-ae02-9b13c8d6134c with scrape type 2
2026-01-27 21:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26bcaf00-9213-546a-ae02-9b13c8d6134c with scrape type 2
2026-01-27 21:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26bcaf00-9213-546a-ae02-9b13c8d6134c, identifier: NX59013
2026-01-27 21:02:04 [auto1.it] INFO: Found listing with ID: VW84140
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW84140%27 HTTP/1.1" 200 None
2026-01-27 21:02:04 [auto1.it] INFO: Scrape type for VW84140: 0
2026-01-27 21:02:04 [auto1.it] INFO: Found listing with ID: UJ20487
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ20487%27 HTTP/1.1" 200 None
2026-01-27 21:02:04 [auto1.it] INFO: Scrape type for UJ20487: 2
2026-01-27 21:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330
2026-01-27 21:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330
2026-01-27 21:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0c5fc905-c2ee-5ccc-a62a-23438572850d with identifier: KV39330 to the API
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV39330>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:15:42Z',
'fuel_type': 'petrol',
'id': '0c5fc905-c2ee-5ccc-a62a-23438572850d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV39330',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 55221,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39330%27 HTTP/1.1" 200 None
2026-01-27 21:02:04 [auto1.it] INFO: Saving data for KV39330: {'auction_closing_time': 1769616942.0, 'created_time': 1769112379.378631, 'last_price_update_time': 1769547724.828809}
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KV39330') HTTP/1.1" 204 0
2026-01-27 21:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013
2026-01-27 21:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013
2026-01-27 21:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26bcaf00-9213-546a-ae02-9b13c8d6134c with identifier: NX59013 to the API
2026-01-27 21:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX59013>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:53:50Z',
'fuel_type': 'diesel',
'id': '26bcaf00-9213-546a-ae02-9b13c8d6134c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX59013',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 98192,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX59013%27 HTTP/1.1" 200 None
2026-01-27 21:02:05 [auto1.it] INFO: Saving data for NX59013: {'auction_closing_time': 1769619230.0, 'created_time': 1769025694.700034, 'last_price_update_time': 1769547725.157844}
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NX59013') HTTP/1.1" 204 0
2026-01-27 21:02:05 [auto1.it] INFO: Found listing with ID: KH16920
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH16920%27 HTTP/1.1" 200 None
2026-01-27 21:02:05 [auto1.it] INFO: Scrape type for KH16920: 2
2026-01-27 21:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY89378> (referer: https://www.auto1.com/v1/car-details-view/GY89378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198
2026-01-27 21:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d614629a-03c0-56b5-a30f-bb6cf687bb87 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d614629a-03c0-56b5-a30f-bb6cf687bb87 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d614629a-03c0-56b5-a30f-bb6cf687bb87, identifier: GH67198
2026-01-27 21:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b70e4c-1ef8-532a-a58a-531db4753dc1 with identifier: HA18231
2026-01-27 21:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b70e4c-1ef8-532a-a58a-531db4753dc1 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7b70e4c-1ef8-532a-a58a-531db4753dc1 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7b70e4c-1ef8-532a-a58a-531db4753dc1, identifier: HA18231
2026-01-27 21:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193
2026-01-27 21:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0, identifier: FG75193
2026-01-27 21:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896
2026-01-27 21:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with scrape type 2
2026-01-27 21:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3, identifier: XN08896
2026-01-27 21:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198
2026-01-27 21:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198
2026-01-27 21:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d614629a-03c0-56b5-a30f-bb6cf687bb87 with identifier: GH67198 to the API
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GH67198>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-01-28T16:12:34Z',
'fuel_type': 'diesel',
'id': 'd614629a-03c0-56b5-a30f-bb6cf687bb87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH67198',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 42777,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Business',
'transmission': 'automatic',
'trim': '4Matic Business',
'year': 2019}
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH67198%27 HTTP/1.1" 200 None
2026-01-27 21:02:05 [auto1.it] INFO: Saving data for GH67198: {'auction_closing_time': 1769616754.0, 'created_time': 1768464057.45225, 'last_price_update_time': 1769547725.90378}
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GH67198') HTTP/1.1" 204 0
2026-01-27 21:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7b70e4c-1ef8-532a-a58a-531db4753dc1 with identifier: HA18231
2026-01-27 21:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7b70e4c-1ef8-532a-a58a-531db4753dc1 with identifier: HA18231
2026-01-27 21:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'lynk & co 01 1.5 plug-in hybrid', 'price': 0, 'currency': 'eur', 'make': 'lynk & co', 'model': '01', 'transmission': 'automatic', 'odometer': 79024, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha18231', 'expiration_date': '2026-01-28t16:45:02z', 'origin_country_code': 'it', 'trim': '', 'year': 2022, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 179, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.5l', 'location': 'it, roma', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 24, 'id': 'd7b70e4c-1ef8-532a-a58a-531db4753dc1', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'lynk & co 01', 'sanitized_make': 'lynkco', 'odometer_in_km': 79024}
Failed validating None in schema:
False
On instance:
{'age_in_months': 38,
'auction_title': '',
'c_o_2_emission_value': 24,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.5l',
'engine_horse_power': 179,
'expiration_date': '2026-01-28t16:45:02z',
'fuel_type': 'hybrid',
'id': 'd7b70e4c-1ef8-532a-a58a-531db4753dc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha18231',
'listing': 'auction',
'location': 'it, roma',
'make': 'lynk & co',
'make_model': 'lynk & co 01',
'model': '01',
'odometer': 79024,
'odometer_in_km': 79024,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-21',
'sanitized_make': 'lynkco',
'seats_number': 5,
'seller_name': None,
'title': 'lynk & co 01 1.5 plug-in hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-01-27 21:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: d7b70e4c-1ef8-532a-a58a-531db4753dc1 spider: auto1.it
2026-01-27 21:02:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d7b70e4c-1ef8-532a-a58a-531db4753dc1 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'lynk & co 01 1.5 plug-in hybrid', 'price': 0, 'currency': 'eur', 'make': 'lynk & co', 'model': '01', 'transmission': 'automatic', 'odometer': 79024, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha18231', 'expiration_date': '2026-01-28t16:45:02z', 'origin_country_code': 'it', 'trim': '', 'year': 2022, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 179, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.5l', 'location': 'it, roma', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 24, 'id': 'd7b70e4c-1ef8-532a-a58a-531db4753dc1', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'lynk & co 01', 'sanitized_make': 'lynkco', 'odometer_in_km': 79024}
Failed validating None in schema:
False
On instance:
{'age_in_months': 38,
'auction_title': '',
'c_o_2_emission_value': 24,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.5l',
'engine_horse_power': 179,
'expiration_date': '2026-01-28t16:45:02z',
'fuel_type': 'hybrid',
'id': 'd7b70e4c-1ef8-532a-a58a-531db4753dc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha18231',
'listing': 'auction',
'location': 'it, roma',
'make': 'lynk & co',
'make_model': 'lynk & co 01',
'model': '01',
'odometer': 79024,
'odometer_in_km': 79024,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-21',
'sanitized_make': 'lynkco',
'seats_number': 5,
'seller_name': None,
'title': 'lynk & co 01 1.5 plug-in hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 24,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 179,
'expiration_date': '2026-01-28T16:45:02Z',
'fuel_type': 'hybrid',
'id': 'd7b70e4c-1ef8-532a-a58a-531db4753dc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA18231',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Lynk & Co',
'model': '01',
'odometer': 79024,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Lynk & Co 01 1.5 Plug-in Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA18231%27 HTTP/1.1" 200 None
2026-01-27 21:02:06 [auto1.it] INFO: Saving data for HA18231: {'auction_closing_time': 1769618702.0, 'created_time': 1767902494.461714, 'last_price_update_time': 1769547726.126667}
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HA18231') HTTP/1.1" 204 0
2026-01-27 21:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193
2026-01-27 21:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193
2026-01-27 21:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1236750b-b0fa-516e-9e24-bb9a5a18f1b0 with identifier: FG75193 to the API
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG75193>
{'auction_title': '',
'c_o_2_emission_value': 49,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 306,
'expiration_date': '2026-01-28T16:33:54Z',
'fuel_type': 'hybrid',
'id': '1236750b-b0fa-516e-9e24-bb9a5a18f1b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG75193',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 90907,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-05',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2021}
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG75193%27 HTTP/1.1" 200 None
2026-01-27 21:02:06 [auto1.it] INFO: Saving data for FG75193: {'auction_closing_time': 1769618034.0, 'created_time': 1768248365.153934, 'last_price_update_time': 1769547726.435168}
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FG75193') HTTP/1.1" 204 0
2026-01-27 21:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896
2026-01-27 21:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896
2026-01-27 21:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c088b92-f4be-5ba0-ae8c-3c469797a6c3 with identifier: XN08896 to the API
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XN08896>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:43:58Z',
'fuel_type': 'petrol',
'id': '9c088b92-f4be-5ba0-ae8c-3c469797a6c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN08896',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 73305,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2019}
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN08896%27 HTTP/1.1" 200 None
2026-01-27 21:02:06 [auto1.it] INFO: Saving data for XN08896: {'auction_closing_time': 1769618638.0, 'created_time': 1769458555.130719, 'last_price_update_time': 1769547726.731391}
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XN08896') HTTP/1.1" 204 0
2026-01-27 21:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV71014> (referer: https://www.auto1.com/v1/car-details-view/AV71014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG40810> (referer: https://www.auto1.com/v1/car-details-view/EG40810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC32462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378
2026-01-27 21:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecaed355-487c-59e6-b231-0ca0caf1c0ed with scrape type 2
2026-01-27 21:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecaed355-487c-59e6-b231-0ca0caf1c0ed with scrape type 2
2026-01-27 21:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ecaed355-487c-59e6-b231-0ca0caf1c0ed, identifier: GY89378
2026-01-27 21:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378
2026-01-27 21:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378
2026-01-27 21:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ecaed355-487c-59e6-b231-0ca0caf1c0ed with identifier: GY89378 to the API
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY89378>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:52:11Z',
'fuel_type': 'diesel',
'id': 'ecaed355-487c-59e6-b231-0ca0caf1c0ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY89378',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'BMW',
'model': 'X1',
'odometer': 81486,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 16d',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY89378%27 HTTP/1.1" 200 None
2026-01-27 21:02:07 [auto1.it] INFO: Saving data for GY89378: {'auction_closing_time': 1769619131.0, 'created_time': 1769458418.643215, 'last_price_update_time': 1769547727.255973}
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY89378') HTTP/1.1" 204 0
2026-01-27 21:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014
2026-01-27 21:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a11177-772b-5bf8-b834-b833c7d592e2 with scrape type 2
2026-01-27 21:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a11177-772b-5bf8-b834-b833c7d592e2 with scrape type 2
2026-01-27 21:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85a11177-772b-5bf8-b834-b833c7d592e2, identifier: AV71014
2026-01-27 21:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810
2026-01-27 21:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a1e1df-ec29-5258-9c33-81e1a0695744 with scrape type 2
2026-01-27 21:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a1e1df-ec29-5258-9c33-81e1a0695744 with scrape type 2
2026-01-27 21:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3a1e1df-ec29-5258-9c33-81e1a0695744, identifier: EG40810
2026-01-27 21:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014
2026-01-27 21:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014
2026-01-27 21:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85a11177-772b-5bf8-b834-b833c7d592e2 with identifier: AV71014 to the API
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV71014>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 193,
'expiration_date': '2026-01-28T16:10:19Z',
'fuel_type': 'diesel',
'id': '85a11177-772b-5bf8-b834-b833c7d592e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV71014',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 10142,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2024}
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV71014%27 HTTP/1.1" 200 None
2026-01-27 21:02:07 [auto1.it] INFO: Saving data for AV71014: {'auction_closing_time': 1769616619.0, 'created_time': 1769458340.000779, 'last_price_update_time': 1769547727.766283}
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AV71014') HTTP/1.1" 204 0
2026-01-27 21:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810
2026-01-27 21:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810
2026-01-27 21:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f3a1e1df-ec29-5258-9c33-81e1a0695744 with identifier: EG40810 to the API
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG40810>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:35:00Z',
'fuel_type': 'diesel',
'id': 'f3a1e1df-ec29-5258-9c33-81e1a0695744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG40810',
'listing': 'auction',
'location': 'IT, Casamassima',
'make': 'BMW',
'model': 'X1',
'odometer': 112736,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-19',
'seats_number': 4,
'seller_name': None,
'title': 'BMW X1 sDrive 18d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG40810%27 HTTP/1.1" 200 None
2026-01-27 21:02:08 [auto1.it] INFO: Saving data for EG40810: {'auction_closing_time': 1769618100.0, 'created_time': 1769458353.199078, 'last_price_update_time': 1769547728.084048}
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG40810') HTTP/1.1" 204 0
2026-01-27 21:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH04520> (referer: https://www.auto1.com/v1/car-details-view/VH04520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB69922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF46047> (referer: https://www.auto1.com/v1/car-details-view/TF46047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN16265> (referer: https://www.auto1.com/v1/car-details-view/SN16265/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520
2026-01-27 21:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e8a557-d8a0-5a60-bcf8-227b3274298a with scrape type 2
2026-01-27 21:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e8a557-d8a0-5a60-bcf8-227b3274298a with scrape type 2
2026-01-27 21:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61e8a557-d8a0-5a60-bcf8-227b3274298a, identifier: VH04520
2026-01-27 21:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520
2026-01-27 21:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520
2026-01-27 21:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61e8a557-d8a0-5a60-bcf8-227b3274298a with identifier: VH04520 to the API
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH04520>
{'auction_title': '',
'c_o_2_emission_value': 36,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 309,
'expiration_date': '2026-01-28T16:05:34Z',
'fuel_type': 'hybrid',
'id': '61e8a557-d8a0-5a60-bcf8-227b3274298a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH04520',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 29995,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport P300e Hybrid R-Dynamic SE AWD',
'transmission': 'automatic',
'trim': 'R-Dynamic SE AWD',
'year': 2023}
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH04520%27 HTTP/1.1" 200 None
2026-01-27 21:02:08 [auto1.it] INFO: Saving data for VH04520: {'auction_closing_time': 1769616334.0, 'created_time': 1769026030.574272, 'last_price_update_time': 1769547728.608332}
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH04520') HTTP/1.1" 204 0
2026-01-27 21:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f969c22-26ee-5216-bc0e-b67fc34017b1 with identifier: TF46047
2026-01-27 21:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f969c22-26ee-5216-bc0e-b67fc34017b1 with scrape type 2
2026-01-27 21:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f969c22-26ee-5216-bc0e-b67fc34017b1 with scrape type 2
2026-01-27 21:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6f969c22-26ee-5216-bc0e-b67fc34017b1, identifier: TF46047
2026-01-27 21:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6f969c22-26ee-5216-bc0e-b67fc34017b1 with identifier: TF46047
2026-01-27 21:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6f969c22-26ee-5216-bc0e-b67fc34017b1 with identifier: TF46047
2026-01-27 21:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178364 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178364
2026-01-27 21:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6f969c22-26ee-5216-bc0e-b67fc34017b1 spider: auto1.it
2026-01-27 21:02:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 6f969c22-26ee-5216-bc0e-b67fc34017b1 due to rule: high_mileage_for_country.json, error: 178364 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178364
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.3L',
'engine_horse_power': 179,
'expiration_date': '2026-01-28T16:31:52Z',
'fuel_type': 'petrol',
'id': '6f969c22-26ee-5216-bc0e-b67fc34017b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF46047',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 178364,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.3 TGDi Limited 4x4',
'transmission': 'automatic',
'trim': 'Limited 4x4',
'year': 2020}
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF46047%27 HTTP/1.1" 200 None
2026-01-27 21:02:08 [auto1.it] INFO: Saving data for TF46047: {'auction_closing_time': 1769617912.0, 'created_time': 1769457947.547254, 'last_price_update_time': 1769547728.931946}
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF46047') HTTP/1.1" 204 0
2026-01-27 21:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA81726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a with identifier: SN16265
2026-01-27 21:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a with scrape type 2
2026-01-27 21:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a with scrape type 2
2026-01-27 21:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a, identifier: SN16265
2026-01-27 21:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a with identifier: SN16265
2026-01-27 21:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a with identifier: SN16265
2026-01-27 21:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a with identifier: SN16265 to the API
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN16265>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-01-28T16:56:51Z',
'fuel_type': 'petrol',
'id': '1bc26d59-4432-5ceb-9e26-0eb8c6c9c70a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN16265',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 67433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-08',
'seats_number': 4,
'seller_name': None,
'title': 'Lancia Ypsilon 1.0 Mild-Hybrid Silver',
'transmission': 'manual',
'trim': 'Silver',
'year': 2022}
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN16265%27 HTTP/1.1" 200 None
2026-01-27 21:02:09 [auto1.it] INFO: Saving data for SN16265: {'auction_closing_time': 1769619411.0, 'created_time': 1769458156.18713, 'last_price_update_time': 1769547729.389247}
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN16265') HTTP/1.1" 204 0
2026-01-27 21:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH21247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY98220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT57275> (referer: https://www.auto1.com/v1/car-details-view/GT57275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b04f087-0ba1-5816-9d6e-874fa5385209 with identifier: GT57275
2026-01-27 21:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b04f087-0ba1-5816-9d6e-874fa5385209 with scrape type 2
2026-01-27 21:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b04f087-0ba1-5816-9d6e-874fa5385209 with scrape type 2
2026-01-27 21:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b04f087-0ba1-5816-9d6e-874fa5385209, identifier: GT57275
2026-01-27 21:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b04f087-0ba1-5816-9d6e-874fa5385209 with identifier: GT57275
2026-01-27 21:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b04f087-0ba1-5816-9d6e-874fa5385209 with identifier: GT57275
2026-01-27 21:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
155338
2026-01-27 21:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5b04f087-0ba1-5816-9d6e-874fa5385209 spider: auto1.it
2026-01-27 21:02:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5b04f087-0ba1-5816-9d6e-874fa5385209 due to rule: high_mileage_for_country.json, error: 155338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
155338
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:30:36Z',
'fuel_type': 'diesel',
'id': '5b04f087-0ba1-5816-9d6e-874fa5385209',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT57275',
'listing': 'auction',
'location': 'IT, Taranto',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 155338,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT57275%27 HTTP/1.1" 200 None
2026-01-27 21:02:09 [auto1.it] INFO: Saving data for GT57275: {'auction_closing_time': 1769617836.0, 'created_time': 1769458279.924436, 'last_price_update_time': 1769547729.826626}
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT57275') HTTP/1.1" 204 0
2026-01-27 21:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU21154/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB40645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX13232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL75822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH16920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY21953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ20487/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL36672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL30417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU93011/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC32462> (referer: https://www.auto1.com/v1/car-details-view/HC32462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN18613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbf219e-196a-50c2-ae6b-79229429eb78 with identifier: HC32462
2026-01-27 21:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbf219e-196a-50c2-ae6b-79229429eb78 with scrape type 2
2026-01-27 21:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcbf219e-196a-50c2-ae6b-79229429eb78 with scrape type 2
2026-01-27 21:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fcbf219e-196a-50c2-ae6b-79229429eb78, identifier: HC32462
2026-01-27 21:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fcbf219e-196a-50c2-ae6b-79229429eb78 with identifier: HC32462
2026-01-27 21:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fcbf219e-196a-50c2-ae6b-79229429eb78 with identifier: HC32462
2026-01-27 21:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fcbf219e-196a-50c2-ae6b-79229429eb78 with identifier: HC32462 to the API
2026-01-27 21:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HC32462>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 209,
'expiration_date': '2026-01-28T16:40:48Z',
'fuel_type': 'diesel',
'id': 'fcbf219e-196a-50c2-ae6b-79229429eb78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC32462',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 112558,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
'transmission': 'automatic',
'trim': 'Veloce Q4',
'year': 2021}
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC32462%27 HTTP/1.1" 200 None
2026-01-27 21:02:13 [auto1.it] INFO: Saving data for HC32462: {'auction_closing_time': 1769618448.0, 'created_time': 1769458255.639762, 'last_price_update_time': 1769547733.06681}
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HC32462') HTTP/1.1" 204 0
2026-01-27 21:02:13 [scrapy.extensions.logstats] INFO: Crawled 384 pages (at 202 pages/min), scraped 139 items (at 78 items/min)
2026-01-27 21:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP55119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP28374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB69922> (referer: https://www.auto1.com/v1/car-details-view/AB69922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1dde822-c794-5e1d-b24e-3a775558bf09 with identifier: AB69922
2026-01-27 21:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1dde822-c794-5e1d-b24e-3a775558bf09 with scrape type 2
2026-01-27 21:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1dde822-c794-5e1d-b24e-3a775558bf09 with scrape type 2
2026-01-27 21:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b1dde822-c794-5e1d-b24e-3a775558bf09, identifier: AB69922
2026-01-27 21:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b1dde822-c794-5e1d-b24e-3a775558bf09 with identifier: AB69922
2026-01-27 21:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b1dde822-c794-5e1d-b24e-3a775558bf09 with identifier: AB69922
2026-01-27 21:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b1dde822-c794-5e1d-b24e-3a775558bf09 with identifier: AB69922 to the API
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB69922>
{'auction_title': '',
'c_o_2_emission_value': 51,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 320,
'expiration_date': '2026-01-28T16:26:48Z',
'fuel_type': 'hybrid',
'id': 'b1dde822-c794-5e1d-b24e-3a775558bf09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB69922',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 76140,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic Executive',
'transmission': 'automatic',
'trim': '4Matic Executive',
'year': 2020}
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB69922%27 HTTP/1.1" 200 None
2026-01-27 21:02:13 [auto1.it] INFO: Saving data for AB69922: {'auction_closing_time': 1769617608.0, 'created_time': 1768817045.362393, 'last_price_update_time': 1769547733.592228}
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB69922') HTTP/1.1" 204 0
2026-01-27 21:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH21247> (referer: https://www.auto1.com/v1/car-details-view/JH21247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY98220> (referer: https://www.auto1.com/v1/car-details-view/BY98220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA81726> (referer: https://www.auto1.com/v1/car-details-view/UA81726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 517eb998-bec1-5d6b-b5e2-6b397518a8db with identifier: JH21247
2026-01-27 21:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 517eb998-bec1-5d6b-b5e2-6b397518a8db with scrape type 2
2026-01-27 21:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 517eb998-bec1-5d6b-b5e2-6b397518a8db with scrape type 2
2026-01-27 21:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 517eb998-bec1-5d6b-b5e2-6b397518a8db, identifier: JH21247
2026-01-27 21:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220
2026-01-27 21:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56423a48-20c0-5784-b301-2669b752030a with scrape type 2
2026-01-27 21:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56423a48-20c0-5784-b301-2669b752030a with scrape type 2
2026-01-27 21:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56423a48-20c0-5784-b301-2669b752030a, identifier: BY98220
2026-01-27 21:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 517eb998-bec1-5d6b-b5e2-6b397518a8db with identifier: JH21247
2026-01-27 21:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 517eb998-bec1-5d6b-b5e2-6b397518a8db with identifier: JH21247
2026-01-27 21:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158891 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158891
2026-01-27 21:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 517eb998-bec1-5d6b-b5e2-6b397518a8db spider: auto1.it
2026-01-27 21:02:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 517eb998-bec1-5d6b-b5e2-6b397518a8db due to rule: high_mileage_for_country.json, error: 158891 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158891
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.9L',
'engine_horse_power': 285,
'expiration_date': '2026-01-28T16:42:10Z',
'fuel_type': 'diesel',
'id': '517eb998-bec1-5d6b-b5e2-6b397518a8db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH21247',
'listing': 'auction',
'location': "IT, Cassano D'Adda",
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 158891,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic Premium',
'transmission': 'automatic',
'trim': '4Matic Premium',
'year': 2018}
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH21247%27 HTTP/1.1" 200 None
2026-01-27 21:02:14 [auto1.it] INFO: Saving data for JH21247: {'auction_closing_time': 1769618530.0, 'created_time': 1769457828.951325, 'last_price_update_time': 1769547734.396863}
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH21247') HTTP/1.1" 204 0
2026-01-27 21:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220
2026-01-27 21:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220
2026-01-27 21:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220 to the API
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY98220>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:26:54Z',
'fuel_type': 'diesel',
'id': '56423a48-20c0-5784-b301-2669b752030a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY98220',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Audi',
'model': 'Q3',
'odometer': 114258,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-23',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2019}
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY98220%27 HTTP/1.1" 200 None
2026-01-27 21:02:14 [auto1.it] INFO: Saving data for BY98220: {'auction_closing_time': 1769617614.0, 'created_time': 1769458140.137336, 'last_price_update_time': 1769547734.714037}
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY98220') HTTP/1.1" 204 0
2026-01-27 21:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT72404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN58298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726
2026-01-27 21:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc25b93-47f7-596c-94df-409439a75cc6 with scrape type 2
2026-01-27 21:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc25b93-47f7-596c-94df-409439a75cc6 with scrape type 2
2026-01-27 21:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbc25b93-47f7-596c-94df-409439a75cc6, identifier: UA81726
2026-01-27 21:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726
2026-01-27 21:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726
2026-01-27 21:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbc25b93-47f7-596c-94df-409439a75cc6 with identifier: UA81726 to the API
2026-01-27 21:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA81726>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:34:00Z',
'fuel_type': 'diesel',
'id': 'bbc25b93-47f7-596c-94df-409439a75cc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA81726',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 54715,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-01-27 21:02:16 [auto1.it] INFO: Saving data for UA81726: {'auction_closing_time': 1769618040.0, 'created_time': 1768507638.805556, 'last_price_update_time': 1769547736.193812}
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA81726') HTTP/1.1" 204 0
2026-01-27 21:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL75822> (referer: https://www.auto1.com/v1/car-details-view/UL75822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX13232> (referer: https://www.auto1.com/v1/car-details-view/ZX13232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH16920> (referer: https://www.auto1.com/v1/car-details-view/KH16920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with identifier: UL75822
2026-01-27 21:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with scrape type 2
2026-01-27 21:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with scrape type 2
2026-01-27 21:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f758e2f0-5518-50f2-b08e-5dd10e3c6f11, identifier: UL75822
2026-01-27 21:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with identifier: ZX13232
2026-01-27 21:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with scrape type 2
2026-01-27 21:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with scrape type 2
2026-01-27 21:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f, identifier: ZX13232
2026-01-27 21:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e52d9c5-0323-5e60-9d84-9907d056f7d0 with identifier: KH16920
2026-01-27 21:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e52d9c5-0323-5e60-9d84-9907d056f7d0 with scrape type 2
2026-01-27 21:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e52d9c5-0323-5e60-9d84-9907d056f7d0 with scrape type 2
2026-01-27 21:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e52d9c5-0323-5e60-9d84-9907d056f7d0, identifier: KH16920
2026-01-27 21:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with identifier: UL75822
2026-01-27 21:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 with identifier: UL75822
2026-01-27 21:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165157 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165157
2026-01-27 21:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 spider: auto1.it
2026-01-27 21:02:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f758e2f0-5518-50f2-b08e-5dd10e3c6f11 due to rule: high_mileage_for_country.json, error: 165157 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165157
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-01-28T16:12:42Z',
'fuel_type': 'diesel',
'id': 'f758e2f0-5518-50f2-b08e-5dd10e3c6f11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL75822',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'BMW',
'model': 'X5',
'odometer': 165157,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL75822%27 HTTP/1.1" 200 None
2026-01-27 21:02:16 [auto1.it] INFO: Saving data for UL75822: {'auction_closing_time': 1769616762.0, 'created_time': 1769025969.181828, 'last_price_update_time': 1769547736.822299}
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL75822') HTTP/1.1" 204 0
2026-01-27 21:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with identifier: ZX13232
2026-01-27 21:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f with identifier: ZX13232
2026-01-27 21:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 138389 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
138389
2026-01-27 21:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f spider: auto1.it
2026-01-27 21:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f due to rule: high_mileage_for_make.json, error: 138389 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
138389
{'auction_title': '',
'c_o_2_emission_value': 198,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 280,
'expiration_date': '2026-01-28T16:16:50Z',
'fuel_type': 'petrol',
'id': 'f8fb8b41-e8c5-5221-82bb-c70c6a54ce3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX13232',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 138389,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.0 Turbo Veloce Q4',
'transmission': 'automatic',
'trim': 'Veloce Q4',
'year': 2022}
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX13232%27 HTTP/1.1" 200 None
2026-01-27 21:02:17 [auto1.it] INFO: Saving data for ZX13232: {'auction_closing_time': 1769617010.0, 'created_time': 1767816753.74687, 'last_price_update_time': 1769547737.067654}
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX13232') HTTP/1.1" 204 0
2026-01-27 21:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e52d9c5-0323-5e60-9d84-9907d056f7d0 with identifier: KH16920
2026-01-27 21:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e52d9c5-0323-5e60-9d84-9907d056f7d0 with identifier: KH16920
2026-01-27 21:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161942 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
161942
2026-01-27 21:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8e52d9c5-0323-5e60-9d84-9907d056f7d0 spider: auto1.it
2026-01-27 21:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8e52d9c5-0323-5e60-9d84-9907d056f7d0 due to rule: high_mileage_for_country.json, error: 161942 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
161942
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:16:17Z',
'fuel_type': 'diesel',
'id': '8e52d9c5-0323-5e60-9d84-9907d056f7d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH16920',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 161942,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH16920%27 HTTP/1.1" 200 None
2026-01-27 21:02:17 [auto1.it] INFO: Saving data for KH16920: {'auction_closing_time': 1769616977.0, 'created_time': 1769458020.554616, 'last_price_update_time': 1769547737.279799}
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KH16920') HTTP/1.1" 204 0
2026-01-27 21:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB40645> (referer: https://www.auto1.com/v1/car-details-view/ZB40645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ20487> (referer: https://www.auto1.com/v1/car-details-view/UJ20487/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY21953> (referer: https://www.auto1.com/v1/car-details-view/AY21953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645
2026-01-27 21:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bf362b-0887-5f89-9fcc-c5965d51795b with scrape type 2
2026-01-27 21:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73bf362b-0887-5f89-9fcc-c5965d51795b with scrape type 2
2026-01-27 21:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73bf362b-0887-5f89-9fcc-c5965d51795b, identifier: ZB40645
2026-01-27 21:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645
2026-01-27 21:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645
2026-01-27 21:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73bf362b-0887-5f89-9fcc-c5965d51795b with identifier: ZB40645 to the API
2026-01-27 21:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB40645>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-01-28T16:51:26Z',
'fuel_type': 'petrol',
'id': '73bf362b-0887-5f89-9fcc-c5965d51795b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB40645',
'listing': 'auction',
'location': 'IT, Imola',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 34943,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB40645%27 HTTP/1.1" 200 None
2026-01-27 21:02:19 [auto1.it] INFO: Saving data for ZB40645: {'auction_closing_time': 1769619086.0, 'created_time': 1769458427.628137, 'last_price_update_time': 1769547739.202213}
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZB40645') HTTP/1.1" 204 0
2026-01-27 21:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e8a71c-35c8-5da5-8e80-eac7b017d6ce with identifier: UJ20487
2026-01-27 21:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e8a71c-35c8-5da5-8e80-eac7b017d6ce with scrape type 2
2026-01-27 21:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43e8a71c-35c8-5da5-8e80-eac7b017d6ce with scrape type 2
2026-01-27 21:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43e8a71c-35c8-5da5-8e80-eac7b017d6ce, identifier: UJ20487
2026-01-27 21:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU21154> (referer: https://www.auto1.com/v1/car-details-view/UU21154/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD72134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43e8a71c-35c8-5da5-8e80-eac7b017d6ce with identifier: UJ20487
2026-01-27 21:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43e8a71c-35c8-5da5-8e80-eac7b017d6ce with identifier: UJ20487
2026-01-27 21:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43e8a71c-35c8-5da5-8e80-eac7b017d6ce with identifier: UJ20487 to the API
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UJ20487>
{'auction_title': '',
'c_o_2_emission_value': 175,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2026-01-28T16:30:24Z',
'fuel_type': 'diesel',
'id': '43e8a71c-35c8-5da5-8e80-eac7b017d6ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ20487',
'listing': 'auction',
'location': 'IT, Gallarate',
'make': 'Audi',
'model': 'Q5 Sportback',
'odometer': 91266,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ20487%27 HTTP/1.1" 200 None
2026-01-27 21:02:19 [auto1.it] INFO: Saving data for UJ20487: {'auction_closing_time': 1769617824.0, 'created_time': 1769457753.864633, 'last_price_update_time': 1769547739.663284}
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UJ20487') HTTP/1.1" 204 0
2026-01-27 21:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953
2026-01-27 21:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e34844f-c35a-5a93-90c1-c41953f35416 with scrape type 2
2026-01-27 21:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e34844f-c35a-5a93-90c1-c41953f35416 with scrape type 2
2026-01-27 21:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e34844f-c35a-5a93-90c1-c41953f35416, identifier: AY21953
2026-01-27 21:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953
2026-01-27 21:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953
2026-01-27 21:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e34844f-c35a-5a93-90c1-c41953f35416 with identifier: AY21953 to the API
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY21953>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:22:55Z',
'fuel_type': 'petrol',
'id': '5e34844f-c35a-5a93-90c1-c41953f35416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY21953',
'listing': 'auction',
'location': 'IT, Piacenza',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 144707,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21953%27 HTTP/1.1" 200 None
2026-01-27 21:02:20 [auto1.it] INFO: Saving data for AY21953: {'auction_closing_time': 1769617375.0, 'created_time': 1769458073.371229, 'last_price_update_time': 1769547740.076145}
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY21953') HTTP/1.1" 204 0
2026-01-27 21:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154
2026-01-27 21:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54718c8f-054a-50d3-b0db-3e149b768de4 with scrape type 2
2026-01-27 21:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54718c8f-054a-50d3-b0db-3e149b768de4 with scrape type 2
2026-01-27 21:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54718c8f-054a-50d3-b0db-3e149b768de4, identifier: UU21154
2026-01-27 21:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154
2026-01-27 21:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154
2026-01-27 21:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54718c8f-054a-50d3-b0db-3e149b768de4 with identifier: UU21154 to the API
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UU21154>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2026-01-28T16:55:29Z',
'fuel_type': 'hybrid',
'id': '54718c8f-054a-50d3-b0db-3e149b768de4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU21154',
'listing': 'auction',
'location': 'IT, Vercelli (VC)',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 118355,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid Grand Chic 4x4',
'transmission': 'automatic',
'trim': 'Grand Chic 4x4',
'year': 2020}
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU21154%27 HTTP/1.1" 200 None
2026-01-27 21:02:20 [auto1.it] INFO: Saving data for UU21154: {'auction_closing_time': 1769619329.0, 'created_time': 1769458477.423629, 'last_price_update_time': 1769547740.500256}
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU21154') HTTP/1.1" 204 0
2026-01-27 21:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL36672> (referer: https://www.auto1.com/v1/car-details-view/SL36672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU93011> (referer: https://www.auto1.com/v1/car-details-view/FU93011/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL30417> (referer: https://www.auto1.com/v1/car-details-view/XL30417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP55119> (referer: https://www.auto1.com/v1/car-details-view/NP55119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN18613> (referer: https://www.auto1.com/v1/car-details-view/RN18613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP28374> (referer: https://www.auto1.com/v1/car-details-view/JP28374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672
2026-01-27 21:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf29ab44-de37-5347-8e30-53df43a8966e with scrape type 2
2026-01-27 21:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf29ab44-de37-5347-8e30-53df43a8966e with scrape type 2
2026-01-27 21:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf29ab44-de37-5347-8e30-53df43a8966e, identifier: SL36672
2026-01-27 21:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e09f4465-6517-5f2c-a7a2-ad89e7786273 with identifier: FU93011
2026-01-27 21:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09f4465-6517-5f2c-a7a2-ad89e7786273 with scrape type 2
2026-01-27 21:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e09f4465-6517-5f2c-a7a2-ad89e7786273 with scrape type 2
2026-01-27 21:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e09f4465-6517-5f2c-a7a2-ad89e7786273, identifier: FU93011
2026-01-27 21:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672
2026-01-27 21:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672
2026-01-27 21:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf29ab44-de37-5347-8e30-53df43a8966e with identifier: SL36672 to the API
2026-01-27 21:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL36672>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:12:25Z',
'fuel_type': 'diesel',
'id': 'bf29ab44-de37-5347-8e30-53df43a8966e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL36672',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Audi',
'model': 'Q3',
'odometer': 86657,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2019}
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL36672%27 HTTP/1.1" 200 None
2026-01-27 21:02:21 [auto1.it] INFO: Saving data for SL36672: {'auction_closing_time': 1769616745.0, 'created_time': 1769025935.68702, 'last_price_update_time': 1769547741.124925}
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SL36672') HTTP/1.1" 204 0
2026-01-27 21:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e09f4465-6517-5f2c-a7a2-ad89e7786273 with identifier: FU93011
2026-01-27 21:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e09f4465-6517-5f2c-a7a2-ad89e7786273 with identifier: FU93011
2026-01-27 21:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163402 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163402
2026-01-27 21:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e09f4465-6517-5f2c-a7a2-ad89e7786273 spider: auto1.it
2026-01-27 21:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e09f4465-6517-5f2c-a7a2-ad89e7786273 due to rule: high_mileage_for_country.json, error: 163402 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163402
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 265,
'expiration_date': '2026-01-28T16:37:20Z',
'fuel_type': 'hybrid',
'id': 'e09f4465-6517-5f2c-a7a2-ad89e7786273',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU93011',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 163402,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid N Line 4WD',
'transmission': 'automatic',
'trim': 'N Line 4WD',
'year': 2022}
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU93011%27 HTTP/1.1" 200 None
2026-01-27 21:02:21 [auto1.it] INFO: Saving data for FU93011: {'auction_closing_time': 1769618240.0, 'created_time': 1769457967.680984, 'last_price_update_time': 1769547741.364707}
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU93011') HTTP/1.1" 204 0
2026-01-27 21:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417
2026-01-27 21:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5231a76b-f35f-5d90-b627-c1022e02af71 with scrape type 2
2026-01-27 21:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5231a76b-f35f-5d90-b627-c1022e02af71 with scrape type 2
2026-01-27 21:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5231a76b-f35f-5d90-b627-c1022e02af71, identifier: XL30417
2026-01-27 21:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417
2026-01-27 21:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417
2026-01-27 21:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5231a76b-f35f-5d90-b627-c1022e02af71 with identifier: XL30417 to the API
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL30417>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-01-28T16:57:35Z',
'fuel_type': 'petrol',
'id': '5231a76b-f35f-5d90-b627-c1022e02af71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL30417',
'listing': 'auction',
'location': 'Taranto',
'make': 'Fiat',
'model': '124 Spider',
'odometer': 62163,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-30',
'seats_number': 2,
'seller_name': None,
'title': 'Fiat 124 Spider 1.4 Turbo Lusso',
'transmission': 'manual',
'trim': 'Lusso',
'year': 2018}
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL30417%27 HTTP/1.1" 200 None
2026-01-27 21:02:21 [auto1.it] INFO: Saving data for XL30417: {'auction_closing_time': 1769619455.0, 'created_time': 1769458381.778878, 'last_price_update_time': 1769547741.779593}
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL30417') HTTP/1.1" 204 0
2026-01-27 21:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f564fab-d87d-57ad-84ef-560497aacf2d with identifier: NP55119
2026-01-27 21:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f564fab-d87d-57ad-84ef-560497aacf2d with scrape type 2
2026-01-27 21:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f564fab-d87d-57ad-84ef-560497aacf2d with scrape type 2
2026-01-27 21:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f564fab-d87d-57ad-84ef-560497aacf2d, identifier: NP55119
2026-01-27 21:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a6b196-5778-50b8-90fd-eee699a542b3 with identifier: RN18613
2026-01-27 21:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a6b196-5778-50b8-90fd-eee699a542b3 with scrape type 2
2026-01-27 21:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a6b196-5778-50b8-90fd-eee699a542b3 with scrape type 2
2026-01-27 21:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 29a6b196-5778-50b8-90fd-eee699a542b3, identifier: RN18613
2026-01-27 21:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4fc8e10-9b4b-5d52-869d-00d86974916b with identifier: JP28374
2026-01-27 21:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fc8e10-9b4b-5d52-869d-00d86974916b with scrape type 2
2026-01-27 21:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4fc8e10-9b4b-5d52-869d-00d86974916b with scrape type 2
2026-01-27 21:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4fc8e10-9b4b-5d52-869d-00d86974916b, identifier: JP28374
2026-01-27 21:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f564fab-d87d-57ad-84ef-560497aacf2d with identifier: NP55119
2026-01-27 21:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f564fab-d87d-57ad-84ef-560497aacf2d with identifier: NP55119
2026-01-27 21:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
2026-01-27 21:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2f564fab-d87d-57ad-84ef-560497aacf2d spider: auto1.it
2026-01-27 21:02:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 2f564fab-d87d-57ad-84ef-560497aacf2d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
{'auction_title': '',
'c_o_2_emission_value': 203,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:41:02Z',
'fuel_type': 'diesel',
'id': '2f564fab-d87d-57ad-84ef-560497aacf2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP55119',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 156899,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-24',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline FWD',
'transmission': 'automatic',
'trim': 'Trendline FWD',
'year': 2021}
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP55119%27 HTTP/1.1" 200 None
2026-01-27 21:02:22 [auto1.it] INFO: Saving data for NP55119: {'auction_closing_time': 1769618462.0, 'created_time': 1768075405.071264, 'last_price_update_time': 1769547742.280715}
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP55119') HTTP/1.1" 204 0
2026-01-27 21:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 29a6b196-5778-50b8-90fd-eee699a542b3 with identifier: RN18613
2026-01-27 21:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 29a6b196-5778-50b8-90fd-eee699a542b3 with identifier: RN18613
2026-01-27 21:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158020 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158020
2026-01-27 21:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29a6b196-5778-50b8-90fd-eee699a542b3 spider: auto1.it
2026-01-27 21:02:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 29a6b196-5778-50b8-90fd-eee699a542b3 due to rule: high_mileage_for_country.json, error: 158020 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158020
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:14:27Z',
'fuel_type': 'diesel',
'id': '29a6b196-5778-50b8-90fd-eee699a542b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN18613',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Renault',
'model': 'Megane',
'odometer': 158020,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2018}
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN18613%27 HTTP/1.1" 200 None
2026-01-27 21:02:22 [auto1.it] INFO: Saving data for RN18613: {'auction_closing_time': 1769616867.0, 'created_time': 1768557707.720141, 'last_price_update_time': 1769547742.509636}
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN18613') HTTP/1.1" 204 0
2026-01-27 21:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4fc8e10-9b4b-5d52-869d-00d86974916b with identifier: JP28374
2026-01-27 21:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4fc8e10-9b4b-5d52-869d-00d86974916b with identifier: JP28374
2026-01-27 21:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4fc8e10-9b4b-5d52-869d-00d86974916b with identifier: JP28374 to the API
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JP28374>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-01-28T16:12:49Z',
'fuel_type': 'petrol',
'id': 'd4fc8e10-9b4b-5d52-869d-00d86974916b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP28374',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Citroen',
'model': 'C3',
'odometer': 107381,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP28374%27 HTTP/1.1" 200 None
2026-01-27 21:02:22 [auto1.it] INFO: Saving data for JP28374: {'auction_closing_time': 1769616769.0, 'created_time': 1769458159.25083, 'last_price_update_time': 1769547742.851415}
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP28374') HTTP/1.1" 204 0
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN54929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD39232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR13454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN58298> (referer: https://www.auto1.com/v1/car-details-view/EN58298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT72404> (referer: https://www.auto1.com/v1/car-details-view/FT72404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ52499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE68041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ74171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01ae3de-508a-5933-ab2e-7092f7434f44 with identifier: EN58298
2026-01-27 21:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01ae3de-508a-5933-ab2e-7092f7434f44 with scrape type 2
2026-01-27 21:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b01ae3de-508a-5933-ab2e-7092f7434f44 with scrape type 2
2026-01-27 21:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b01ae3de-508a-5933-ab2e-7092f7434f44, identifier: EN58298
2026-01-27 21:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404
2026-01-27 21:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61672f30-9c24-5b23-b669-1d55b1b23af4 with scrape type 2
2026-01-27 21:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61672f30-9c24-5b23-b669-1d55b1b23af4 with scrape type 2
2026-01-27 21:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61672f30-9c24-5b23-b669-1d55b1b23af4, identifier: FT72404
2026-01-27 21:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b01ae3de-508a-5933-ab2e-7092f7434f44 with identifier: EN58298
2026-01-27 21:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b01ae3de-508a-5933-ab2e-7092f7434f44 with identifier: EN58298
2026-01-27 21:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b01ae3de-508a-5933-ab2e-7092f7434f44 with identifier: EN58298 to the API
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN58298>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-01-28T16:15:20Z',
'fuel_type': 'diesel',
'id': 'b01ae3de-508a-5933-ab2e-7092f7434f44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN58298',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Opel',
'model': 'Astra',
'odometer': 134506,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI Business Start/Stop',
'transmission': 'automatic',
'trim': 'Business Start/Stop',
'year': 2018}
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN58298%27 HTTP/1.1" 200 None
2026-01-27 21:02:23 [auto1.it] INFO: Saving data for EN58298: {'auction_closing_time': 1769616920.0, 'created_time': 1769025650.430428, 'last_price_update_time': 1769547743.566691}
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN58298') HTTP/1.1" 204 0
2026-01-27 21:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404
2026-01-27 21:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404
2026-01-27 21:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61672f30-9c24-5b23-b669-1d55b1b23af4 with identifier: FT72404 to the API
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FT72404>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 114,
'expiration_date': '2026-01-28T16:34:37Z',
'fuel_type': 'gas',
'id': '61672f30-9c24-5b23-b669-1d55b1b23af4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT72404',
'listing': 'auction',
'location': 'IT, Palermo',
'make': 'DR',
'model': 'DR 4.0',
'odometer': 54818,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 4.0 1.5 LPG',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT72404%27 HTTP/1.1" 200 None
2026-01-27 21:02:23 [auto1.it] INFO: Saving data for FT72404: {'auction_closing_time': 1769618077.0, 'created_time': 1769458407.32214, 'last_price_update_time': 1769547743.883912}
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT72404') HTTP/1.1" 204 0
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN67455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS38459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL53737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA57164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS84479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF49505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD72134> (referer: https://www.auto1.com/v1/car-details-view/RD72134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM80859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d57302-857a-50ef-a21c-335f1c1bced6 with identifier: RD72134
2026-01-27 21:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d57302-857a-50ef-a21c-335f1c1bced6 with scrape type 2
2026-01-27 21:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d57302-857a-50ef-a21c-335f1c1bced6 with scrape type 2
2026-01-27 21:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64d57302-857a-50ef-a21c-335f1c1bced6, identifier: RD72134
2026-01-27 21:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64d57302-857a-50ef-a21c-335f1c1bced6 with identifier: RD72134
2026-01-27 21:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64d57302-857a-50ef-a21c-335f1c1bced6 with identifier: RD72134
2026-01-27 21:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64d57302-857a-50ef-a21c-335f1c1bced6 with identifier: RD72134 to the API
2026-01-27 21:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD72134>
{'auction_title': '',
'c_o_2_emission_value': 38,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.4L',
'engine_horse_power': 245,
'expiration_date': '2026-01-28T16:18:35Z',
'fuel_type': 'hybrid',
'id': '64d57302-857a-50ef-a21c-335f1c1bced6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD72134',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 41948,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 45 TFSIe',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-01-27 21:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD72134%27 HTTP/1.1" 200 None
2026-01-27 21:02:25 [auto1.it] INFO: Saving data for RD72134: {'auction_closing_time': 1769617115.0, 'created_time': 1769458096.843598, 'last_price_update_time': 1769547745.203611}
2026-01-27 21:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD72134') HTTP/1.1" 204 0
2026-01-27 21:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR32652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY06074> (referer: https://www.auto1.com/v1/car-details-view/YY06074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC94766> (referer: https://www.auto1.com/v1/car-details-view/NC94766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF86127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH94577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY58438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-01-27 21:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with scrape type 2
2026-01-27 21:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with scrape type 2
2026-01-27 21:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b, identifier: YY06074
2026-01-27 21:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-01-27 21:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-01-27 21:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074 to the API
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY06074>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 300,
'expiration_date': '2026-01-28T16:26:03Z',
'fuel_type': 'diesel',
'id': '4d50980f-b7d1-58d5-9381-a4dfc5cedc0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY06074',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 68559,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Velar D300 R-Dynamic S',
'transmission': 'automatic',
'trim': 'R-Dynamic S',
'year': 2020}
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-01-27 21:02:26 [auto1.it] INFO: Saving data for YY06074: {'auction_closing_time': 1769617563.0, 'created_time': 1768507465.139085, 'last_price_update_time': 1769547746.443333}
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY06074') HTTP/1.1" 204 0
2026-01-27 21:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-01-27 21:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678ab250-2141-5cce-a7ad-2903cb78c4c5 with scrape type 2
2026-01-27 21:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 678ab250-2141-5cce-a7ad-2903cb78c4c5 with scrape type 2
2026-01-27 21:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 678ab250-2141-5cce-a7ad-2903cb78c4c5, identifier: NC94766
2026-01-27 21:02:26 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-01-27 21:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-01-27 21:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766 to the API
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NC94766>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:21:00Z',
'fuel_type': 'hybrid',
'id': '678ab250-2141-5cce-a7ad-2903cb78c4c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC94766',
'listing': 'auction',
'location': 'IT, Palermo',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 37037,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Trend',
'transmission': 'automatic',
'trim': '2WD Trend',
'year': 2022}
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-01-27 21:02:26 [auto1.it] INFO: Saving data for NC94766: {'auction_closing_time': 1769617260.0, 'created_time': 1769458546.426406, 'last_price_update_time': 1769547746.888366}
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC94766') HTTP/1.1" 204 0
2026-01-27 21:02:26 [auto1.it] INFO: Found listing with ID: AP68870
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP68870%27 HTTP/1.1" 200 None
2026-01-27 21:02:26 [auto1.it] INFO: Scrape type for AP68870: 0
2026-01-27 21:02:26 [auto1.it] INFO: Found listing with ID: GN74198
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN74198%27 HTTP/1.1" 200 None
2026-01-27 21:02:26 [auto1.it] INFO: Scrape type for GN74198: 0
2026-01-27 21:02:26 [auto1.it] INFO: Found listing with ID: XW74392
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW74392%27 HTTP/1.1" 200 None
2026-01-27 21:02:26 [auto1.it] INFO: Scrape type for XW74392: 2
2026-01-27 21:02:26 [auto1.it] INFO: Found listing with ID: GT07178
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT07178%27 HTTP/1.1" 200 None
2026-01-27 21:02:26 [auto1.it] INFO: Scrape type for GT07178: 0
2026-01-27 21:02:26 [auto1.it] INFO: Found listing with ID: RW40398
2026-01-27 21:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW40398%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for RW40398: 2
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: NK32002
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK32002%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for NK32002: 2
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: CH15659
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH15659%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for CH15659: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: JR02113
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02113%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for JR02113: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: RM66243
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66243%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for RM66243: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: FU48439
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU48439%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for FU48439: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: ZP37659
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP37659%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for ZP37659: 2
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: LY72233
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY72233%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for LY72233: 2
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW18274> (referer: https://www.auto1.com/v1/car-details-view/VW18274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: JJ36044
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ36044%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for JJ36044: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: UU87248
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU87248%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for UU87248: 2
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: ZG56309
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG56309%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for ZG56309: 2
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: ZX15052
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX15052%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for ZX15052: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: AT20318
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for AT20318: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: JR34638
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR34638%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for JR34638: 0
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: RF35677
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF35677%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for RF35677: 2
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: ZK76849
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK76849%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for ZK76849: 2
2026-01-27 21:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274
2026-01-27 21:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with scrape type 2
2026-01-27 21:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with scrape type 2
2026-01-27 21:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894, identifier: VW18274
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: RL06920
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for RL06920: 2
2026-01-27 21:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274
2026-01-27 21:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274
2026-01-27 21:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274 to the API
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW18274>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 265,
'expiration_date': '2026-01-28T16:42:13Z',
'fuel_type': 'hybrid',
'id': '25f2bdee-ba41-5b35-a5a0-48b0b0d63894',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW18274',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 101249,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Exellence 4WD',
'transmission': 'automatic',
'trim': 'Exellence 4WD',
'year': 2021}
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW18274%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Saving data for VW18274: {'auction_closing_time': 1769618533.0, 'created_time': 1769076121.039989, 'last_price_update_time': 1769547747.769691}
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VW18274') HTTP/1.1" 204 0
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ74171> (referer: https://www.auto1.com/v1/car-details-view/GJ74171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: EJ52665
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52665%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for EJ52665: 2
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD39232> (referer: https://www.auto1.com/v1/car-details-view/RD39232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN54929> (referer: https://www.auto1.com/v1/car-details-view/YN54929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD04779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR13454> (referer: https://www.auto1.com/v1/car-details-view/NR13454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ52499> (referer: https://www.auto1.com/v1/car-details-view/EJ52499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: SL26814
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL26814%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for SL26814: 2
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE68041> (referer: https://www.auto1.com/v1/car-details-view/KE68041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: RX14856
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX14856%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for RX14856: 2
2026-01-27 21:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:27 [auto1.it] INFO: Found listing with ID: FS37784
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS37784%27 HTTP/1.1" 200 None
2026-01-27 21:02:27 [auto1.it] INFO: Scrape type for FS37784: 2
2026-01-27 21:02:28 [auto1.it] INFO: Found listing with ID: GJ05057
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ05057%27 HTTP/1.1" 200 None
2026-01-27 21:02:28 [auto1.it] INFO: Scrape type for GJ05057: 0
2026-01-27 21:02:28 [auto1.it] INFO: Found listing with ID: AF06947
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF06947%27 HTTP/1.1" 200 None
2026-01-27 21:02:28 [auto1.it] INFO: Scrape type for AF06947: 2
2026-01-27 21:02:28 [auto1.it] INFO: Found listing with ID: YJ87014
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87014%27 HTTP/1.1" 200 None
2026-01-27 21:02:28 [auto1.it] INFO: Scrape type for YJ87014: 0
2026-01-27 21:02:28 [auto1.it] INFO: Found listing with ID: XF61996
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF61996%27 HTTP/1.1" 200 None
2026-01-27 21:02:28 [auto1.it] INFO: Scrape type for XF61996: 2
2026-01-27 21:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6198c72e-a439-561b-bcc2-cf38aea0baa4 with identifier: GJ74171
2026-01-27 21:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6198c72e-a439-561b-bcc2-cf38aea0baa4 with scrape type 2
2026-01-27 21:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6198c72e-a439-561b-bcc2-cf38aea0baa4 with scrape type 2
2026-01-27 21:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6198c72e-a439-561b-bcc2-cf38aea0baa4, identifier: GJ74171
2026-01-27 21:02:28 [auto1.it] INFO: Found listing with ID: WM15511
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM15511%27 HTTP/1.1" 200 None
2026-01-27 21:02:28 [auto1.it] INFO: Scrape type for WM15511: 0
2026-01-27 21:02:28 [auto1.it] INFO: Found listing with ID: RV79194
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV79194%27 HTTP/1.1" 200 None
2026-01-27 21:02:28 [auto1.it] INFO: Scrape type for RV79194: 2
2026-01-27 21:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6198c72e-a439-561b-bcc2-cf38aea0baa4 with identifier: GJ74171
2026-01-27 21:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6198c72e-a439-561b-bcc2-cf38aea0baa4 with identifier: GJ74171
2026-01-27 21:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6198c72e-a439-561b-bcc2-cf38aea0baa4 with identifier: GJ74171 to the API
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GJ74171>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:28:42Z',
'fuel_type': 'petrol',
'id': '6198c72e-a439-561b-bcc2-cf38aea0baa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ74171',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Audi',
'model': 'Q2',
'odometer': 84858,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ74171%27 HTTP/1.1" 200 None
2026-01-27 21:02:28 [auto1.it] INFO: Saving data for GJ74171: {'auction_closing_time': 1769617722.0, 'created_time': 1769076365.423747, 'last_price_update_time': 1769547748.510326}
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ74171') HTTP/1.1" 204 0
2026-01-27 21:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232
2026-01-27 21:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d06c2057-cdfc-5676-a287-b5564f080177 with scrape type 2
2026-01-27 21:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d06c2057-cdfc-5676-a287-b5564f080177 with scrape type 2
2026-01-27 21:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d06c2057-cdfc-5676-a287-b5564f080177, identifier: RD39232
2026-01-27 21:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa472b39-ee9f-5f96-85aa-79e49c55a314 with identifier: YN54929
2026-01-27 21:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa472b39-ee9f-5f96-85aa-79e49c55a314 with scrape type 2
2026-01-27 21:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa472b39-ee9f-5f96-85aa-79e49c55a314 with scrape type 2
2026-01-27 21:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa472b39-ee9f-5f96-85aa-79e49c55a314, identifier: YN54929
2026-01-27 21:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c0d0a6-d680-505b-8562-8c6b4009a320 with identifier: NR13454
2026-01-27 21:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c0d0a6-d680-505b-8562-8c6b4009a320 with scrape type 2
2026-01-27 21:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c0d0a6-d680-505b-8562-8c6b4009a320 with scrape type 2
2026-01-27 21:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3c0d0a6-d680-505b-8562-8c6b4009a320, identifier: NR13454
2026-01-27 21:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499
2026-01-27 21:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e107f2-32d4-5730-a440-9e86282c7956 with scrape type 2
2026-01-27 21:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e107f2-32d4-5730-a440-9e86282c7956 with scrape type 2
2026-01-27 21:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2e107f2-32d4-5730-a440-9e86282c7956, identifier: EJ52499
2026-01-27 21:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 with identifier: KE68041
2026-01-27 21:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ea5b4e0-4825-523f-ae61-ef7650a22085 with scrape type 2
2026-01-27 21:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ea5b4e0-4825-523f-ae61-ef7650a22085 with scrape type 2
2026-01-27 21:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ea5b4e0-4825-523f-ae61-ef7650a22085, identifier: KE68041
2026-01-27 21:02:29 [auto1.it] INFO: Found listing with ID: AC98886
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC98886%27 HTTP/1.1" 200 None
2026-01-27 21:02:29 [auto1.it] INFO: Scrape type for AC98886: 2
2026-01-27 21:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232
2026-01-27 21:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232
2026-01-27 21:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d06c2057-cdfc-5676-a287-b5564f080177 with identifier: RD39232 to the API
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD39232>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:33:54Z',
'fuel_type': 'petrol',
'id': 'd06c2057-cdfc-5676-a287-b5564f080177',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD39232',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volvo',
'model': 'XC40',
'odometer': 77078,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 2.0 T4 R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2019}
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD39232%27 HTTP/1.1" 200 None
2026-01-27 21:02:29 [auto1.it] INFO: Saving data for RD39232: {'auction_closing_time': 1769618034.0, 'created_time': 1769458079.532569, 'last_price_update_time': 1769547749.515792}
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD39232') HTTP/1.1" 204 0
2026-01-27 21:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa472b39-ee9f-5f96-85aa-79e49c55a314 with identifier: YN54929
2026-01-27 21:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa472b39-ee9f-5f96-85aa-79e49c55a314 with identifier: YN54929
2026-01-27 21:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191135 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191135
2026-01-27 21:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fa472b39-ee9f-5f96-85aa-79e49c55a314 spider: auto1.it
2026-01-27 21:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fa472b39-ee9f-5f96-85aa-79e49c55a314 due to rule: high_mileage_for_country.json, error: 191135 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191135
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:02:52Z',
'fuel_type': 'diesel',
'id': 'fa472b39-ee9f-5f96-85aa-79e49c55a314',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN54929',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 191135,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Executive BlueMotion',
'transmission': 'automatic',
'trim': 'Executive BlueMotion',
'year': 2018}
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN54929%27 HTTP/1.1" 200 None
2026-01-27 21:02:29 [auto1.it] INFO: Saving data for YN54929: {'auction_closing_time': 1769616172.0, 'created_time': 1768644139.196618, 'last_price_update_time': 1769547749.846908}
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN54929') HTTP/1.1" 204 0
2026-01-27 21:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3c0d0a6-d680-505b-8562-8c6b4009a320 with identifier: NR13454
2026-01-27 21:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3c0d0a6-d680-505b-8562-8c6b4009a320 with identifier: NR13454
2026-01-27 21:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151102 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151102
2026-01-27 21:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f3c0d0a6-d680-505b-8562-8c6b4009a320 spider: auto1.it
2026-01-27 21:02:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f3c0d0a6-d680-505b-8562-8c6b4009a320 due to rule: high_mileage_for_country.json, error: 151102 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151102
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-01-28T16:03:02Z',
'fuel_type': 'diesel',
'id': 'f3c0d0a6-d680-505b-8562-8c6b4009a320',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR13454',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Kia',
'model': 'Sportage',
'odometer': 151102,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi GT Line 4WD',
'transmission': 'automatic',
'trim': 'GT Line 4WD',
'year': 2019}
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR13454%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Saving data for NR13454: {'auction_closing_time': 1769616182.0, 'created_time': 1769025655.738013, 'last_price_update_time': 1769547750.108077}
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR13454') HTTP/1.1" 204 0
2026-01-27 21:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499
2026-01-27 21:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499
2026-01-27 21:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2e107f2-32d4-5730-a440-9e86282c7956 with identifier: EJ52499 to the API
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ52499>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:29:20Z',
'fuel_type': 'petrol',
'id': 'e2e107f2-32d4-5730-a440-9e86282c7956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ52499',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 65681,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-05',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2021}
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52499%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Saving data for EJ52499: {'auction_closing_time': 1769617760.0, 'created_time': 1768593641.208731, 'last_price_update_time': 1769547750.520434}
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ52499') HTTP/1.1" 204 0
2026-01-27 21:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 with identifier: KE68041
2026-01-27 21:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 with identifier: KE68041
2026-01-27 21:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165683 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165683
2026-01-27 21:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5ea5b4e0-4825-523f-ae61-ef7650a22085 spider: auto1.it
2026-01-27 21:02:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5ea5b4e0-4825-523f-ae61-ef7650a22085 due to rule: high_mileage_for_country.json, error: 165683 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165683
{'auction_title': '',
'c_o_2_emission_value': 233,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 249,
'expiration_date': '2026-01-28T16:56:13Z',
'fuel_type': 'diesel',
'id': '5ea5b4e0-4825-523f-ae61-ef7650a22085',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE68041',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 165683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport D250 Mild-Hybrid HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2021}
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE68041%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Saving data for KE68041: {'auction_closing_time': 1769619373.0, 'created_time': 1768507253.750833, 'last_price_update_time': 1769547750.802883}
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE68041') HTTP/1.1" 204 0
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: BW20992
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW20992%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for BW20992: 2
2026-01-27 21:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL53737> (referer: https://www.auto1.com/v1/car-details-view/YL53737/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: NC36424
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC36424%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for NC36424: 0
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: BH18095
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH18095%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for BH18095: 2
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: KU22756
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU22756%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for KU22756: 2
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: ZN56285
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN56285%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for ZN56285: 0
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: ZA57365
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA57365%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for ZA57365: 0
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: KE54965
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE54965%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for KE54965: 2
2026-01-27 21:02:30 [auto1.it] INFO: Found listing with ID: BP00644
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP00644%27 HTTP/1.1" 200 None
2026-01-27 21:02:30 [auto1.it] INFO: Scrape type for BP00644: 0
2026-01-27 21:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-01-27 21:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84e96b8-b29e-506f-a259-a9c4d1a64df5 with scrape type 2
2026-01-27 21:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84e96b8-b29e-506f-a259-a9c4d1a64df5 with scrape type 2
2026-01-27 21:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d84e96b8-b29e-506f-a259-a9c4d1a64df5, identifier: YL53737
2026-01-27 21:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-01-27 21:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-01-27 21:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737 to the API
2026-01-27 21:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL53737>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:49:00Z',
'fuel_type': 'diesel',
'id': 'd84e96b8-b29e-506f-a259-a9c4d1a64df5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL53737',
'listing': 'auction',
'location': 'IT, Foggia',
'make': 'Audi',
'model': 'Q3',
'odometer': 70738,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 40 TDI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2020}
2026-01-27 21:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-01-27 21:02:31 [auto1.it] INFO: Saving data for YL53737: {'auction_closing_time': 1769618940.0, 'created_time': 1769458535.881674, 'last_price_update_time': 1769547751.679338}
2026-01-27 21:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL53737') HTTP/1.1" 204 0
2026-01-27 21:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM80859> (referer: https://www.auto1.com/v1/car-details-view/UM80859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS38459> (referer: https://www.auto1.com/v1/car-details-view/JS38459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN67455> (referer: https://www.auto1.com/v1/car-details-view/RN67455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS84479> (referer: https://www.auto1.com/v1/car-details-view/PS84479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA57164> (referer: https://www.auto1.com/v1/car-details-view/EA57164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF49505> (referer: https://www.auto1.com/v1/car-details-view/JF49505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a58a46ba-b032-5954-96d9-3f7afbe64cec with identifier: UM80859
2026-01-27 21:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a58a46ba-b032-5954-96d9-3f7afbe64cec with scrape type 2
2026-01-27 21:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a58a46ba-b032-5954-96d9-3f7afbe64cec with scrape type 2
2026-01-27 21:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a58a46ba-b032-5954-96d9-3f7afbe64cec, identifier: UM80859
2026-01-27 21:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459
2026-01-27 21:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with scrape type 2
2026-01-27 21:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with scrape type 2
2026-01-27 21:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b, identifier: JS38459
2026-01-27 21:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a58a46ba-b032-5954-96d9-3f7afbe64cec with identifier: UM80859
2026-01-27 21:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a58a46ba-b032-5954-96d9-3f7afbe64cec with identifier: UM80859
2026-01-27 21:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a58a46ba-b032-5954-96d9-3f7afbe64cec with identifier: UM80859 to the API
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UM80859>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '1.0L',
'engine_horse_power': 71,
'expiration_date': '2026-01-28T16:29:29Z',
'fuel_type': 'petrol',
'id': 'a58a46ba-b032-5954-96d9-3f7afbe64cec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM80859',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Nissan',
'model': 'Micra',
'odometer': 37293,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Micra 1.0 Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2020}
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM80859%27 HTTP/1.1" 200 None
2026-01-27 21:02:32 [auto1.it] INFO: Saving data for UM80859: {'auction_closing_time': 1769617769.0, 'created_time': 1769284854.810608, 'last_price_update_time': 1769547752.76751}
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UM80859') HTTP/1.1" 204 0
2026-01-27 21:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459
2026-01-27 21:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459
2026-01-27 21:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b with identifier: JS38459 to the API
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS38459>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:21:35Z',
'fuel_type': 'diesel',
'id': 'efe10c2a-f7f1-58dc-b3c8-5c2462eeeb1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS38459',
'listing': 'auction',
'location': 'Casoria',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 17326,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2019}
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS38459%27 HTTP/1.1" 200 None
2026-01-27 21:02:33 [auto1.it] INFO: Saving data for JS38459: {'auction_closing_time': 1769617295.0, 'created_time': 1769457997.672237, 'last_price_update_time': 1769547753.06794}
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS38459') HTTP/1.1" 204 0
2026-01-27 21:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455
2026-01-27 21:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2faed50-c6a6-56d8-bf0e-de98f3dd538a with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2faed50-c6a6-56d8-bf0e-de98f3dd538a with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2faed50-c6a6-56d8-bf0e-de98f3dd538a, identifier: RN67455
2026-01-27 21:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-01-27 21:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c8f05e-0de6-5509-aab0-060a264f9e11 with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97c8f05e-0de6-5509-aab0-060a264f9e11 with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97c8f05e-0de6-5509-aab0-060a264f9e11, identifier: PS84479
2026-01-27 21:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164
2026-01-27 21:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bced772-4da2-571a-8621-4c4d204ea8db with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bced772-4da2-571a-8621-4c4d204ea8db with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3bced772-4da2-571a-8621-4c4d204ea8db, identifier: EA57164
2026-01-27 21:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505
2026-01-27 21:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with scrape type 2
2026-01-27 21:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5, identifier: JF49505
2026-01-27 21:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY72233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR32652> (referer: https://www.auto1.com/v1/car-details-view/MR32652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455
2026-01-27 21:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455
2026-01-27 21:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2faed50-c6a6-56d8-bf0e-de98f3dd538a with identifier: RN67455 to the API
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN67455>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:08:18Z',
'fuel_type': 'petrol',
'id': 'a2faed50-c6a6-56d8-bf0e-de98f3dd538a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN67455',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 109340,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.0 TGDi Limited 4x2',
'transmission': 'manual',
'trim': 'Limited 4x2',
'year': 2019}
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN67455%27 HTTP/1.1" 200 None
2026-01-27 21:02:33 [auto1.it] INFO: Saving data for RN67455: {'auction_closing_time': 1769616498.0, 'created_time': 1769026126.49655, 'last_price_update_time': 1769547753.780941}
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN67455') HTTP/1.1" 204 0
2026-01-27 21:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-01-27 21:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-01-27 21:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185899 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185899
2026-01-27 21:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 97c8f05e-0de6-5509-aab0-060a264f9e11 spider: auto1.it
2026-01-27 21:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 97c8f05e-0de6-5509-aab0-060a264f9e11 due to rule: high_mileage_for_country.json, error: 185899 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185899
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-01-28T16:38:08Z',
'fuel_type': 'diesel',
'id': '97c8f05e-0de6-5509-aab0-060a264f9e11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS84479',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Peugeot',
'model': '5008',
'odometer': 185899,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-15',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-01-27 21:02:33 [auto1.it] INFO: Saving data for PS84479: {'auction_closing_time': 1769618288.0, 'created_time': 1768075342.763597, 'last_price_update_time': 1769547753.996096}
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS84479') HTTP/1.1" 204 0
2026-01-27 21:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164
2026-01-27 21:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164
2026-01-27 21:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3bced772-4da2-571a-8621-4c4d204ea8db with identifier: EA57164 to the API
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA57164>
{'auction_title': '',
'c_o_2_emission_value': 161,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-01-28T16:54:45Z',
'fuel_type': 'diesel',
'id': '3bced772-4da2-571a-8621-4c4d204ea8db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA57164',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 135884,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Business',
'transmission': 'automatic',
'trim': '4Matic Business',
'year': 2019}
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA57164%27 HTTP/1.1" 200 None
2026-01-27 21:02:34 [auto1.it] INFO: Saving data for EA57164: {'auction_closing_time': 1769619285.0, 'created_time': 1768982479.042918, 'last_price_update_time': 1769547754.32331}
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA57164') HTTP/1.1" 204 0
2026-01-27 21:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505
2026-01-27 21:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505
2026-01-27 21:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffe3aa0d-4c21-5aab-b910-a88c102bc4e5 with identifier: JF49505 to the API
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF49505>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:27:31Z',
'fuel_type': 'petrol',
'id': 'ffe3aa0d-4c21-5aab-b910-a88c102bc4e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF49505',
'listing': 'auction',
'location': 'IT, Napoli',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 96978,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2022}
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF49505%27 HTTP/1.1" 200 None
2026-01-27 21:02:34 [auto1.it] INFO: Saving data for JF49505: {'auction_closing_time': 1769617651.0, 'created_time': 1769458069.675206, 'last_price_update_time': 1769547754.610021}
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF49505') HTTP/1.1" 204 0
2026-01-27 21:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3190d9f5-6977-5921-a87a-d3f509f3be1f with identifier: MR32652
2026-01-27 21:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3190d9f5-6977-5921-a87a-d3f509f3be1f with scrape type 2
2026-01-27 21:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3190d9f5-6977-5921-a87a-d3f509f3be1f with scrape type 2
2026-01-27 21:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3190d9f5-6977-5921-a87a-d3f509f3be1f, identifier: MR32652
2026-01-27 21:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3190d9f5-6977-5921-a87a-d3f509f3be1f with identifier: MR32652
2026-01-27 21:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3190d9f5-6977-5921-a87a-d3f509f3be1f with identifier: MR32652
2026-01-27 21:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3190d9f5-6977-5921-a87a-d3f509f3be1f with identifier: MR32652 to the API
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR32652>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:57:43Z',
'fuel_type': 'petrol',
'id': '3190d9f5-6977-5921-a87a-d3f509f3be1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR32652',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 34489,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-01-27 21:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR32652%27 HTTP/1.1" 200 None
2026-01-27 21:02:35 [auto1.it] INFO: Saving data for MR32652: {'auction_closing_time': 1769619463.0, 'created_time': 1769458393.06509, 'last_price_update_time': 1769547755.041521}
2026-01-27 21:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR32652') HTTP/1.1" 204 0
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ52665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG56309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK76849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF35677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU87248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL06920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE54965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU22756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL26814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW20992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH18095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC98886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV79194/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD04779> (referer: https://www.auto1.com/v1/car-details-view/UD04779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3517a92c-88ca-5494-b2f3-492d36799fa1 with identifier: UD04779
2026-01-27 21:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3517a92c-88ca-5494-b2f3-492d36799fa1 with scrape type 2
2026-01-27 21:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3517a92c-88ca-5494-b2f3-492d36799fa1 with scrape type 2
2026-01-27 21:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3517a92c-88ca-5494-b2f3-492d36799fa1, identifier: UD04779
2026-01-27 21:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3517a92c-88ca-5494-b2f3-492d36799fa1 with identifier: UD04779
2026-01-27 21:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3517a92c-88ca-5494-b2f3-492d36799fa1 with identifier: UD04779
2026-01-27 21:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157338
2026-01-27 21:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3517a92c-88ca-5494-b2f3-492d36799fa1 spider: auto1.it
2026-01-27 21:02:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3517a92c-88ca-5494-b2f3-492d36799fa1 due to rule: high_mileage_for_country.json, error: 157338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157338
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:09:24Z',
'fuel_type': 'diesel',
'id': '3517a92c-88ca-5494-b2f3-492d36799fa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD04779',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 157338,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
'transmission': 'automatic',
'trim': 'Business BlueMotion',
'year': 2019}
2026-01-27 21:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD04779%27 HTTP/1.1" 200 None
2026-01-27 21:02:36 [auto1.it] INFO: Saving data for UD04779: {'auction_closing_time': 1769616564.0, 'created_time': 1768989674.484685, 'last_price_update_time': 1769547756.734558}
2026-01-27 21:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD04779') HTTP/1.1" 204 0
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF61996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF06947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX14856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY72233> (referer: https://www.auto1.com/v1/car-details-view/LY72233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS37784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ52665> (referer: https://www.auto1.com/v1/car-details-view/EJ52665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233
2026-01-27 21:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with scrape type 2
2026-01-27 21:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with scrape type 2
2026-01-27 21:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13f1f70a-0708-51bb-b5b3-c9697335b6d6, identifier: LY72233
2026-01-27 21:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233
2026-01-27 21:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233
2026-01-27 21:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13f1f70a-0708-51bb-b5b3-c9697335b6d6 with identifier: LY72233 to the API
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY72233>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 220,
'expiration_date': '2026-01-28T16:02:46Z',
'fuel_type': 'diesel',
'id': '13f1f70a-0708-51bb-b5b3-c9697335b6d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY72233',
'listing': 'auction',
'location': 'Casagiove',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 95075,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY72233%27 HTTP/1.1" 200 None
2026-01-27 21:02:37 [auto1.it] INFO: Saving data for LY72233: {'auction_closing_time': 1769616166.0, 'created_time': 1769457723.518248, 'last_price_update_time': 1769547757.413494}
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY72233') HTTP/1.1" 204 0
2026-01-27 21:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP37659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665
2026-01-27 21:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b407068d-4a68-526e-afbb-c7ee8731fa4f with scrape type 2
2026-01-27 21:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b407068d-4a68-526e-afbb-c7ee8731fa4f with scrape type 2
2026-01-27 21:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b407068d-4a68-526e-afbb-c7ee8731fa4f, identifier: EJ52665
2026-01-27 21:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665
2026-01-27 21:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665
2026-01-27 21:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b407068d-4a68-526e-afbb-c7ee8731fa4f with identifier: EJ52665 to the API
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ52665>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.3L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:06:19Z',
'fuel_type': 'petrol',
'id': 'b407068d-4a68-526e-afbb-c7ee8731fa4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ52665',
'listing': 'auction',
'location': 'IT, Elmas',
'make': 'Renault',
'model': 'Captur',
'odometer': 78112,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Sport Edition',
'transmission': 'manual',
'trim': 'Sport Edition',
'year': 2019}
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52665%27 HTTP/1.1" 200 None
2026-01-27 21:02:37 [auto1.it] INFO: Saving data for EJ52665: {'auction_closing_time': 1769616379.0, 'created_time': 1769025921.256866, 'last_price_update_time': 1769547757.850866}
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ52665') HTTP/1.1" 204 0
2026-01-27 21:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU87248> (referer: https://www.auto1.com/v1/car-details-view/UU87248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF35677> (referer: https://www.auto1.com/v1/car-details-view/RF35677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL06920> (referer: https://www.auto1.com/v1/car-details-view/RL06920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aed278dd-1a30-5e8b-81ad-df0e750744cc with identifier: UU87248
2026-01-27 21:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aed278dd-1a30-5e8b-81ad-df0e750744cc with scrape type 2
2026-01-27 21:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aed278dd-1a30-5e8b-81ad-df0e750744cc with scrape type 2
2026-01-27 21:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aed278dd-1a30-5e8b-81ad-df0e750744cc, identifier: UU87248
2026-01-27 21:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9b85d6-f08e-5614-b129-2e1b1d07a8d4 with identifier: RF35677
2026-01-27 21:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9b85d6-f08e-5614-b129-2e1b1d07a8d4 with scrape type 2
2026-01-27 21:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b9b85d6-f08e-5614-b129-2e1b1d07a8d4 with scrape type 2
2026-01-27 21:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b9b85d6-f08e-5614-b129-2e1b1d07a8d4, identifier: RF35677
2026-01-27 21:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aed278dd-1a30-5e8b-81ad-df0e750744cc with identifier: UU87248
2026-01-27 21:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aed278dd-1a30-5e8b-81ad-df0e750744cc with identifier: UU87248
2026-01-27 21:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aed278dd-1a30-5e8b-81ad-df0e750744cc with identifier: UU87248 to the API
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UU87248>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.5L',
'engine_horse_power': 190,
'expiration_date': '2026-01-28T16:51:02Z',
'fuel_type': 'hybrid',
'id': 'aed278dd-1a30-5e8b-81ad-df0e750744cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU87248',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Ford',
'model': 'Kuga',
'odometer': 89014,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-19',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2022}
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU87248%27 HTTP/1.1" 200 None
2026-01-27 21:02:38 [auto1.it] INFO: Saving data for UU87248: {'auction_closing_time': 1769619062.0, 'created_time': 1769458230.282691, 'last_price_update_time': 1769547758.47163}
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU87248') HTTP/1.1" 204 0
2026-01-27 21:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b9b85d6-f08e-5614-b129-2e1b1d07a8d4 with identifier: RF35677
2026-01-27 21:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b9b85d6-f08e-5614-b129-2e1b1d07a8d4 with identifier: RF35677
2026-01-27 21:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b9b85d6-f08e-5614-b129-2e1b1d07a8d4 with identifier: RF35677 to the API
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF35677>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-01-28T16:08:38Z',
'fuel_type': 'diesel',
'id': '8b9b85d6-f08e-5614-b129-2e1b1d07a8d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF35677',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Jaguar',
'model': 'XE',
'odometer': 105162,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XE 20d R-Sport',
'transmission': 'automatic',
'trim': 'R-Sport',
'year': 2018}
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF35677%27 HTTP/1.1" 200 None
2026-01-27 21:02:38 [auto1.it] INFO: Saving data for RF35677: {'auction_closing_time': 1769616518.0, 'created_time': 1769200553.896799, 'last_price_update_time': 1769547758.785307}
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF35677') HTTP/1.1" 204 0
2026-01-27 21:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL26814> (referer: https://www.auto1.com/v1/car-details-view/SL26814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK76849> (referer: https://www.auto1.com/v1/car-details-view/ZK76849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-01-27 21:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6863c36a-1598-5ab6-9106-cdd312605390 with scrape type 2
2026-01-27 21:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6863c36a-1598-5ab6-9106-cdd312605390 with scrape type 2
2026-01-27 21:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6863c36a-1598-5ab6-9106-cdd312605390, identifier: RL06920
2026-01-27 21:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE54965> (referer: https://www.auto1.com/v1/car-details-view/KE54965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG56309> (referer: https://www.auto1.com/v1/car-details-view/ZG56309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-01-27 21:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-01-27 21:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920 to the API
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL06920>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-01-28T16:48:06Z',
'fuel_type': 'petrol',
'id': '6863c36a-1598-5ab6-9106-cdd312605390',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL06920',
'listing': 'auction',
'location': 'IT, Perugia',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 39627,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2022}
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-01-27 21:02:39 [auto1.it] INFO: Saving data for RL06920: {'auction_closing_time': 1769618886.0, 'created_time': 1769458189.474758, 'last_price_update_time': 1769547759.248453}
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL06920') HTTP/1.1" 204 0
2026-01-27 21:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814
2026-01-27 21:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a78d3d-65f0-51a0-b4d9-8078aa22613c with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90a78d3d-65f0-51a0-b4d9-8078aa22613c with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90a78d3d-65f0-51a0-b4d9-8078aa22613c, identifier: SL26814
2026-01-27 21:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849
2026-01-27 21:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c973523-6790-5459-9ec6-7f37371d516b with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c973523-6790-5459-9ec6-7f37371d516b with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c973523-6790-5459-9ec6-7f37371d516b, identifier: ZK76849
2026-01-27 21:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd70160-cf32-5264-8ad0-7701a4a36a58 with identifier: KE54965
2026-01-27 21:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd70160-cf32-5264-8ad0-7701a4a36a58 with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdd70160-cf32-5264-8ad0-7701a4a36a58 with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fdd70160-cf32-5264-8ad0-7701a4a36a58, identifier: KE54965
2026-01-27 21:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46fa70af-1acf-588d-9825-63348b987935 with identifier: ZG56309
2026-01-27 21:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46fa70af-1acf-588d-9825-63348b987935 with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46fa70af-1acf-588d-9825-63348b987935 with scrape type 2
2026-01-27 21:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46fa70af-1acf-588d-9825-63348b987935, identifier: ZG56309
2026-01-27 21:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814
2026-01-27 21:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814
2026-01-27 21:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90a78d3d-65f0-51a0-b4d9-8078aa22613c with identifier: SL26814 to the API
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL26814>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:03:40Z',
'fuel_type': 'petrol',
'id': '90a78d3d-65f0-51a0-b4d9-8078aa22613c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL26814',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 24821,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2021}
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL26814%27 HTTP/1.1" 200 None
2026-01-27 21:02:39 [auto1.it] INFO: Saving data for SL26814: {'auction_closing_time': 1769616220.0, 'created_time': 1769458584.402506, 'last_price_update_time': 1769547759.999383}
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SL26814') HTTP/1.1" 204 0
2026-01-27 21:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849
2026-01-27 21:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849
2026-01-27 21:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c973523-6790-5459-9ec6-7f37371d516b with identifier: ZK76849 to the API
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK76849>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 118,
'expiration_date': '2026-01-28T16:07:49Z',
'fuel_type': 'gas',
'id': '1c973523-6790-5459-9ec6-7f37371d516b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK76849',
'listing': 'auction',
'location': 'IT, Beinasco',
'make': 'EVO',
'model': '5',
'odometer': 75918,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'EVO 5 1.6 LPG',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK76849%27 HTTP/1.1" 200 None
2026-01-27 21:02:40 [auto1.it] INFO: Saving data for ZK76849: {'auction_closing_time': 1769616469.0, 'created_time': 1769112505.427908, 'last_price_update_time': 1769547760.314508}
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK76849') HTTP/1.1" 204 0
2026-01-27 21:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fdd70160-cf32-5264-8ad0-7701a4a36a58 with identifier: KE54965
2026-01-27 21:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fdd70160-cf32-5264-8ad0-7701a4a36a58 with identifier: KE54965
2026-01-27 21:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2026-01-27 21:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fdd70160-cf32-5264-8ad0-7701a4a36a58 spider: auto1.it
2026-01-27 21:02:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fdd70160-cf32-5264-8ad0-7701a4a36a58 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
'c_o_2_emission_value': 183,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:16:55Z',
'fuel_type': 'diesel',
'id': 'fdd70160-cf32-5264-8ad0-7701a4a36a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE54965',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 25710,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-23',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Club XS',
'transmission': 'manual',
'trim': 'Club XS',
'year': 2021}
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE54965%27 HTTP/1.1" 200 None
2026-01-27 21:02:40 [auto1.it] INFO: Saving data for KE54965: {'auction_closing_time': 1769617015.0, 'created_time': 1768507535.774277, 'last_price_update_time': 1769547760.539056}
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE54965') HTTP/1.1" 204 0
2026-01-27 21:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46fa70af-1acf-588d-9825-63348b987935 with identifier: ZG56309
2026-01-27 21:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46fa70af-1acf-588d-9825-63348b987935 with identifier: ZG56309
2026-01-27 21:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2026-01-27 21:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 46fa70af-1acf-588d-9825-63348b987935 spider: auto1.it
2026-01-27 21:02:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 46fa70af-1acf-588d-9825-63348b987935 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
'c_o_2_emission_value': 278,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 212,
'expiration_date': '2026-01-28T16:22:42Z',
'fuel_type': 'diesel',
'id': '46fa70af-1acf-588d-9825-63348b987935',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG56309',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Ford',
'model': 'Ranger',
'odometer': 26508,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Raptor',
'year': 2022}
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG56309%27 HTTP/1.1" 200 None
2026-01-27 21:02:40 [auto1.it] INFO: Saving data for ZG56309: {'auction_closing_time': 1769617362.0, 'created_time': 1769457971.551745, 'last_price_update_time': 1769547760.76503}
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG56309') HTTP/1.1" 204 0
2026-01-27 21:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV79194> (referer: https://www.auto1.com/v1/car-details-view/RV79194/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW20992> (referer: https://www.auto1.com/v1/car-details-view/BW20992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH18095> (referer: https://www.auto1.com/v1/car-details-view/BH18095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC98886> (referer: https://www.auto1.com/v1/car-details-view/AC98886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af07fc7-f069-5cd2-87a4-ff70badb3d96 with identifier: RV79194
2026-01-27 21:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af07fc7-f069-5cd2-87a4-ff70badb3d96 with scrape type 2
2026-01-27 21:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5af07fc7-f069-5cd2-87a4-ff70badb3d96 with scrape type 2
2026-01-27 21:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5af07fc7-f069-5cd2-87a4-ff70badb3d96, identifier: RV79194
2026-01-27 21:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5af07fc7-f069-5cd2-87a4-ff70badb3d96 with identifier: RV79194
2026-01-27 21:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5af07fc7-f069-5cd2-87a4-ff70badb3d96 with identifier: RV79194
2026-01-27 21:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5af07fc7-f069-5cd2-87a4-ff70badb3d96 with identifier: RV79194 to the API
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV79194>
{'auction_title': '',
'c_o_2_emission_value': 233,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6D',
'engine': '3.0L',
'engine_horse_power': 510,
'expiration_date': '2026-01-28T16:39:38Z',
'fuel_type': 'petrol',
'id': '5af07fc7-f069-5cd2-87a4-ff70badb3d96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV79194',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'BMW',
'model': '4er',
'odometer': 90305,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-07',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 4er M4 xDrive Competition',
'transmission': 'automatic',
'trim': 'xDrive Competition',
'year': 2022}
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV79194%27 HTTP/1.1" 200 None
2026-01-27 21:02:41 [auto1.it] INFO: Saving data for RV79194: {'auction_closing_time': 1769618378.0, 'created_time': 1769457984.804519, 'last_price_update_time': 1769547761.323416}
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV79194') HTTP/1.1" 204 0
2026-01-27 21:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e0d8f6-2f87-54d8-bee9-2a5886a55478 with identifier: BW20992
2026-01-27 21:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e0d8f6-2f87-54d8-bee9-2a5886a55478 with scrape type 2
2026-01-27 21:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97e0d8f6-2f87-54d8-bee9-2a5886a55478 with scrape type 2
2026-01-27 21:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97e0d8f6-2f87-54d8-bee9-2a5886a55478, identifier: BW20992
2026-01-27 21:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a0049b-9e6e-5863-888a-9a0a0a7ccd9d with identifier: BH18095
2026-01-27 21:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a0049b-9e6e-5863-888a-9a0a0a7ccd9d with scrape type 2
2026-01-27 21:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9a0049b-9e6e-5863-888a-9a0a0a7ccd9d with scrape type 2
2026-01-27 21:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9a0049b-9e6e-5863-888a-9a0a0a7ccd9d, identifier: BH18095
2026-01-27 21:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97e0d8f6-2f87-54d8-bee9-2a5886a55478 with identifier: BW20992
2026-01-27 21:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97e0d8f6-2f87-54d8-bee9-2a5886a55478 with identifier: BW20992
2026-01-27 21:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97e0d8f6-2f87-54d8-bee9-2a5886a55478 with identifier: BW20992 to the API
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW20992>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-01-28T16:42:14Z',
'fuel_type': 'petrol',
'id': '97e0d8f6-2f87-54d8-bee9-2a5886a55478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW20992',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Fiat',
'model': '500',
'odometer': 96783,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-28',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
'transmission': 'manual',
'trim': 'Dolcevita',
'year': 2021}
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW20992%27 HTTP/1.1" 200 None
2026-01-27 21:02:41 [auto1.it] INFO: Saving data for BW20992: {'auction_closing_time': 1769618534.0, 'created_time': 1769457747.604527, 'last_price_update_time': 1769547761.845576}
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW20992') HTTP/1.1" 204 0
2026-01-27 21:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9a0049b-9e6e-5863-888a-9a0a0a7ccd9d with identifier: BH18095
2026-01-27 21:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9a0049b-9e6e-5863-888a-9a0a0a7ccd9d with identifier: BH18095
2026-01-27 21:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9a0049b-9e6e-5863-888a-9a0a0a7ccd9d with identifier: BH18095 to the API
2026-01-27 21:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH18095>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:43:42Z',
'fuel_type': 'petrol',
'id': 'd9a0049b-9e6e-5863-888a-9a0a0a7ccd9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH18095',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 31034,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH18095%27 HTTP/1.1" 200 None
2026-01-27 21:02:42 [auto1.it] INFO: Saving data for BH18095: {'auction_closing_time': 1769618622.0, 'created_time': 1769076373.457149, 'last_price_update_time': 1769547762.178446}
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BH18095') HTTP/1.1" 204 0
2026-01-27 21:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57303857-a7e4-524c-aa1e-27a4e9e591cf with identifier: AC98886
2026-01-27 21:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57303857-a7e4-524c-aa1e-27a4e9e591cf with scrape type 2
2026-01-27 21:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57303857-a7e4-524c-aa1e-27a4e9e591cf with scrape type 2
2026-01-27 21:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57303857-a7e4-524c-aa1e-27a4e9e591cf, identifier: AC98886
2026-01-27 21:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57303857-a7e4-524c-aa1e-27a4e9e591cf with identifier: AC98886
2026-01-27 21:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57303857-a7e4-524c-aa1e-27a4e9e591cf with identifier: AC98886
2026-01-27 21:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57303857-a7e4-524c-aa1e-27a4e9e591cf with identifier: AC98886 to the API
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AC98886>
{'auction_title': '',
'c_o_2_emission_value': 176,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 306,
'expiration_date': '2026-01-28T16:27:22Z',
'fuel_type': 'petrol',
'id': '57303857-a7e4-524c-aa1e-27a4e9e591cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC98886',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'BMW',
'model': '2er',
'odometer': 61446,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2er M235i Gran Coupe xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2021}
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC98886%27 HTTP/1.1" 200 None
2026-01-27 21:02:42 [auto1.it] INFO: Saving data for AC98886: {'auction_closing_time': 1769617642.0, 'created_time': 1769458285.245839, 'last_price_update_time': 1769547762.61049}
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AC98886') HTTP/1.1" 204 0
2026-01-27 21:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK32002/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW74392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF61996> (referer: https://www.auto1.com/v1/car-details-view/XF61996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX14856> (referer: https://www.auto1.com/v1/car-details-view/RX14856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW40398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU22756> (referer: https://www.auto1.com/v1/car-details-view/KU22756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF06947> (referer: https://www.auto1.com/v1/car-details-view/AF06947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS37784> (referer: https://www.auto1.com/v1/car-details-view/FS37784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c60195-9a19-577b-b605-aabbccf394a1 with identifier: XF61996
2026-01-27 21:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c60195-9a19-577b-b605-aabbccf394a1 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c60195-9a19-577b-b605-aabbccf394a1 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5c60195-9a19-577b-b605-aabbccf394a1, identifier: XF61996
2026-01-27 21:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5c60195-9a19-577b-b605-aabbccf394a1 with identifier: XF61996
2026-01-27 21:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5c60195-9a19-577b-b605-aabbccf394a1 with identifier: XF61996
2026-01-27 21:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 21:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c5c60195-9a19-577b-b605-aabbccf394a1 spider: auto1.it
2026-01-27 21:02:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c5c60195-9a19-577b-b605-aabbccf394a1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-01-28T16:54:09Z',
'fuel_type': 'petrol',
'id': 'c5c60195-9a19-577b-b605-aabbccf394a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF61996',
'listing': 'auction',
'location': 'IT, Casamassima',
'make': 'Opel',
'model': 'Combo',
'odometer': 105394,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-30',
'seats_number': 3,
'seller_name': None,
'title': 'Opel Combo 1.2 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2020}
2026-01-27 21:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF61996%27 HTTP/1.1" 200 None
2026-01-27 21:02:43 [auto1.it] INFO: Saving data for XF61996: {'auction_closing_time': 1769619249.0, 'created_time': 1769458522.468753, 'last_price_update_time': 1769547763.386775}
2026-01-27 21:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF61996') HTTP/1.1" 204 0
2026-01-27 21:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856
2026-01-27 21:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a753834c-ca33-5285-afd8-0555dfc952b1 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a753834c-ca33-5285-afd8-0555dfc952b1 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a753834c-ca33-5285-afd8-0555dfc952b1, identifier: RX14856
2026-01-27 21:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27300be7-4cd6-515c-97f2-c8d1743944f7 with identifier: KU22756
2026-01-27 21:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27300be7-4cd6-515c-97f2-c8d1743944f7 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27300be7-4cd6-515c-97f2-c8d1743944f7 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27300be7-4cd6-515c-97f2-c8d1743944f7, identifier: KU22756
2026-01-27 21:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 with identifier: AF06947
2026-01-27 21:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86bf1940-cddf-5529-9fba-a2caf5a832b8 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86bf1940-cddf-5529-9fba-a2caf5a832b8 with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 86bf1940-cddf-5529-9fba-a2caf5a832b8, identifier: AF06947
2026-01-27 21:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784
2026-01-27 21:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with scrape type 2
2026-01-27 21:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f, identifier: FS37784
2026-01-27 21:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856
2026-01-27 21:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856
2026-01-27 21:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a753834c-ca33-5285-afd8-0555dfc952b1 with identifier: RX14856 to the API
2026-01-27 21:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX14856>
{'auction_title': '',
'c_o_2_emission_value': 18,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 326,
'expiration_date': '2026-01-28T16:48:32Z',
'fuel_type': 'hybrid',
'id': 'a753834c-ca33-5285-afd8-0555dfc952b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX14856',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'BMW',
'model': 'X1',
'odometer': 22466,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 30e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2024}
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX14856%27 HTTP/1.1" 200 None
2026-01-27 21:02:44 [auto1.it] INFO: Saving data for RX14856: {'auction_closing_time': 1769618912.0, 'created_time': 1769458449.295062, 'last_price_update_time': 1769547764.09126}
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX14856') HTTP/1.1" 204 0
2026-01-27 21:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27300be7-4cd6-515c-97f2-c8d1743944f7 with identifier: KU22756
2026-01-27 21:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27300be7-4cd6-515c-97f2-c8d1743944f7 with identifier: KU22756
2026-01-27 21:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27300be7-4cd6-515c-97f2-c8d1743944f7 with identifier: KU22756 to the API
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KU22756>
{'auction_title': '',
'c_o_2_emission_value': 36,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 299,
'expiration_date': '2026-01-28T16:31:01Z',
'fuel_type': 'hybrid',
'id': '27300be7-4cd6-515c-97f2-c8d1743944f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU22756',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'A6',
'odometer': 11965,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-08-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 50 TFSIe quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2024}
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU22756%27 HTTP/1.1" 200 None
2026-01-27 21:02:44 [auto1.it] INFO: Saving data for KU22756: {'auction_closing_time': 1769617861.0, 'created_time': 1768471360.725517, 'last_price_update_time': 1769547764.395741}
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KU22756') HTTP/1.1" 204 0
2026-01-27 21:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 with identifier: AF06947
2026-01-27 21:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 with identifier: AF06947
2026-01-27 21:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170825 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170825
2026-01-27 21:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 86bf1940-cddf-5529-9fba-a2caf5a832b8 spider: auto1.it
2026-01-27 21:02:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 86bf1940-cddf-5529-9fba-a2caf5a832b8 due to rule: high_mileage_for_country.json, error: 170825 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170825
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 69,
'expiration_date': '2026-01-28T16:02:59Z',
'fuel_type': 'gas',
'id': '86bf1940-cddf-5529-9fba-a2caf5a832b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF06947',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 170825,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 LPG Elefantino Blu',
'transmission': 'manual',
'trim': 'Elefantino Blu',
'year': 2019}
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF06947%27 HTTP/1.1" 200 None
2026-01-27 21:02:44 [auto1.it] INFO: Saving data for AF06947: {'auction_closing_time': 1769616179.0, 'created_time': 1768593637.573008, 'last_price_update_time': 1769547764.609492}
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF06947') HTTP/1.1" 204 0
2026-01-27 21:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784
2026-01-27 21:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784
2026-01-27 21:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f with identifier: FS37784 to the API
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FS37784>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 86,
'expiration_date': '2026-01-28T16:55:58Z',
'fuel_type': 'petrol',
'id': 'c684420c-c8b6-5bc2-9b2c-2bd7e83bb10f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS37784',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Ford',
'model': 'Ka+',
'odometer': 38982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ka+ 1.2 Ti-VCT Ultimate',
'transmission': 'manual',
'trim': 'Ultimate',
'year': 2019}
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS37784%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Saving data for FS37784: {'auction_closing_time': 1769619358.0, 'created_time': 1768939297.803108, 'last_price_update_time': 1769547765.096972}
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FS37784') HTTP/1.1" 204 0
2026-01-27 21:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP37659> (referer: https://www.auto1.com/v1/car-details-view/ZP37659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:45 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: KR12343
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR12343%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for KR12343: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: NM38508
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM38508%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for NM38508: 2
2026-01-27 21:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d69b829-da51-529b-9b52-aaf9207456df with identifier: ZP37659
2026-01-27 21:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d69b829-da51-529b-9b52-aaf9207456df with scrape type 2
2026-01-27 21:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d69b829-da51-529b-9b52-aaf9207456df with scrape type 2
2026-01-27 21:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d69b829-da51-529b-9b52-aaf9207456df, identifier: ZP37659
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: EN85352
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN85352%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for EN85352: 2
2026-01-27 21:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d69b829-da51-529b-9b52-aaf9207456df with identifier: ZP37659
2026-01-27 21:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d69b829-da51-529b-9b52-aaf9207456df with identifier: ZP37659
2026-01-27 21:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153309 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153309
2026-01-27 21:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3d69b829-da51-529b-9b52-aaf9207456df spider: auto1.it
2026-01-27 21:02:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3d69b829-da51-529b-9b52-aaf9207456df due to rule: high_mileage_for_country.json, error: 153309 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153309
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-01-28T16:35:25Z',
'fuel_type': 'diesel',
'id': '3d69b829-da51-529b-9b52-aaf9207456df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP37659',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'BMW',
'model': '1er',
'odometer': 153309,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP37659%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Saving data for ZP37659: {'auction_closing_time': 1769618125.0, 'created_time': 1769457824.890067, 'last_price_update_time': 1769547765.569055}
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZP37659') HTTP/1.1" 204 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: XX93574
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93574%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for XX93574: 2
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: RW00957
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW00957%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for RW00957: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: BS78089
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS78089%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for BS78089: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: YM48404
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM48404%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for YM48404: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: BU52246
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU52246%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for BU52246: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: HA91981
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA91981%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for HA91981: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: HW92589
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW92589%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for HW92589: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: UU46505
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU46505%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for UU46505: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: WV97974
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV97974%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for WV97974: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: HP27763
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP27763%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for HP27763: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: EA68503
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for EA68503: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: XX71668
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX71668%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for XX71668: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: LV34677
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV34677%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for LV34677: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: DL90680
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL90680%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for DL90680: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: RU40979
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU40979%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for RU40979: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: KJ64767
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ64767%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for KJ64767: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: ZA06304
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA06304%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for ZA06304: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: VW50563
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW50563%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for VW50563: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: DG14106
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG14106%27 HTTP/1.1" 200 None
2026-01-27 21:02:45 [auto1.it] INFO: Scrape type for DG14106: 0
2026-01-27 21:02:45 [auto1.it] INFO: Found listing with ID: CE44712
2026-01-27 21:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE44712%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for CE44712: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: SG47453
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG47453%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for SG47453: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: LU29351
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU29351%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for LU29351: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: CT48603
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT48603%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for CT48603: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: FH85021
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH85021%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for FH85021: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: ZL90358
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL90358%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for ZL90358: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: NG60462
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG60462%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for NG60462: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: UR07815
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR07815%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for UR07815: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: YM26268
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM26268%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for YM26268: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: HW64559
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for HW64559: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: KK65649
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK65649%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for KK65649: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: JT18745
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT18745%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for JT18745: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: XB39028
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB39028%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for XB39028: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: DJ35523
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ35523%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for DJ35523: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: GY05920
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05920%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for GY05920: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: SX16297
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX16297%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for SX16297: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: PN13750
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN13750%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for PN13750: 0
2026-01-27 21:02:46 [auto1.it] INFO: Found listing with ID: AH71898
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH71898%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Scrape type for AH71898: 0
2026-01-27 21:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ25733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH94577> (referer: https://www.auto1.com/v1/car-details-view/ZH94577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD79561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF86127> (referer: https://www.auto1.com/v1/car-details-view/JF86127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB07177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY58438> (referer: https://www.auto1.com/v1/car-details-view/PY58438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be4fb13b-2c0d-5e7c-a38f-4f4bbb227105 with identifier: ZH94577
2026-01-27 21:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be4fb13b-2c0d-5e7c-a38f-4f4bbb227105 with scrape type 2
2026-01-27 21:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be4fb13b-2c0d-5e7c-a38f-4f4bbb227105 with scrape type 2
2026-01-27 21:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be4fb13b-2c0d-5e7c-a38f-4f4bbb227105, identifier: ZH94577
2026-01-27 21:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be4fb13b-2c0d-5e7c-a38f-4f4bbb227105 with identifier: ZH94577
2026-01-27 21:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be4fb13b-2c0d-5e7c-a38f-4f4bbb227105 with identifier: ZH94577
2026-01-27 21:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be4fb13b-2c0d-5e7c-a38f-4f4bbb227105 with identifier: ZH94577 to the API
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH94577>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 220,
'expiration_date': '2026-01-28T16:18:45Z',
'fuel_type': 'diesel',
'id': 'be4fb13b-2c0d-5e7c-a38f-4f4bbb227105',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH94577',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 21935,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2024}
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH94577%27 HTTP/1.1" 200 None
2026-01-27 21:02:46 [auto1.it] INFO: Saving data for ZH94577: {'auction_closing_time': 1769617125.0, 'created_time': 1768557845.529196, 'last_price_update_time': 1769547766.851534}
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH94577') HTTP/1.1" 204 0
2026-01-27 21:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW51000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL96089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923b891d-021a-55cd-9366-87bad72a0858 with identifier: JF86127
2026-01-27 21:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923b891d-021a-55cd-9366-87bad72a0858 with scrape type 2
2026-01-27 21:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 923b891d-021a-55cd-9366-87bad72a0858 with scrape type 2
2026-01-27 21:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 923b891d-021a-55cd-9366-87bad72a0858, identifier: JF86127
2026-01-27 21:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with identifier: PY58438
2026-01-27 21:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with scrape type 2
2026-01-27 21:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with scrape type 2
2026-01-27 21:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6, identifier: PY58438
2026-01-27 21:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 923b891d-021a-55cd-9366-87bad72a0858 with identifier: JF86127
2026-01-27 21:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 923b891d-021a-55cd-9366-87bad72a0858 with identifier: JF86127
2026-01-27 21:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 923b891d-021a-55cd-9366-87bad72a0858 with identifier: JF86127 to the API
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF86127>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 194,
'expiration_date': '2026-01-28T16:57:09Z',
'fuel_type': 'diesel',
'id': '923b891d-021a-55cd-9366-87bad72a0858',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF86127',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 86161,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2019}
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF86127%27 HTTP/1.1" 200 None
2026-01-27 21:02:47 [auto1.it] INFO: Saving data for JF86127: {'auction_closing_time': 1769619429.0, 'created_time': 1769457894.990389, 'last_price_update_time': 1769547767.51182}
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF86127') HTTP/1.1" 204 0
2026-01-27 21:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with identifier: PY58438
2026-01-27 21:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 with identifier: PY58438
2026-01-27 21:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-27 21:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 spider: auto1.it
2026-01-27 21:02:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c1423c4b-ec0b-5cd9-a420-d3dc5866cff6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-01-28T16:32:16Z',
'fuel_type': 'petrol',
'id': 'c1423c4b-ec0b-5cd9-a420-d3dc5866cff6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY58438',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': 'Panda',
'odometer': 58,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-05-15',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58438%27 HTTP/1.1" 200 None
2026-01-27 21:02:47 [auto1.it] INFO: Saving data for PY58438: {'auction_closing_time': 1769617936.0, 'created_time': 1769026118.487316, 'last_price_update_time': 1769547767.818932}
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PY58438') HTTP/1.1" 204 0
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG00560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA25408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW40398> (referer: https://www.auto1.com/v1/car-details-view/RW40398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA54373> (referer: https://www.auto1.com/v1/car-details-view/UA54373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW74392> (referer: https://www.auto1.com/v1/car-details-view/XW74392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR75288> (referer: https://www.auto1.com/v1/car-details-view/AR75288/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK32002> (referer: https://www.auto1.com/v1/car-details-view/NK32002/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f16019-4060-572f-ae73-03eab88073aa with identifier: RW40398
2026-01-27 21:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f16019-4060-572f-ae73-03eab88073aa with scrape type 2
2026-01-27 21:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f16019-4060-572f-ae73-03eab88073aa with scrape type 2
2026-01-27 21:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6f16019-4060-572f-ae73-03eab88073aa, identifier: RW40398
2026-01-27 21:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6f16019-4060-572f-ae73-03eab88073aa with identifier: RW40398
2026-01-27 21:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6f16019-4060-572f-ae73-03eab88073aa with identifier: RW40398
2026-01-27 21:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170301 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170301
2026-01-27 21:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c6f16019-4060-572f-ae73-03eab88073aa spider: auto1.it
2026-01-27 21:02:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c6f16019-4060-572f-ae73-03eab88073aa due to rule: high_mileage_for_country.json, error: 170301 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170301
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-01-28T16:05:38Z',
'fuel_type': 'diesel',
'id': 'c6f16019-4060-572f-ae73-03eab88073aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW40398',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 170301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi Xprime ISG 2WD',
'transmission': 'automatic',
'trim': 'Xprime ISG 2WD',
'year': 2018}
2026-01-27 21:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW40398%27 HTTP/1.1" 200 None
2026-01-27 21:02:48 [auto1.it] INFO: Saving data for RW40398: {'auction_closing_time': 1769616338.0, 'created_time': 1769458397.696937, 'last_price_update_time': 1769547768.952288}
2026-01-27 21:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RW40398') HTTP/1.1" 204 0
2026-01-27 21:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE15416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373
2026-01-27 21:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b873199b-b674-58c3-9642-d8f715c5f2d5 with scrape type 2
2026-01-27 21:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b873199b-b674-58c3-9642-d8f715c5f2d5 with scrape type 2
2026-01-27 21:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b873199b-b674-58c3-9642-d8f715c5f2d5, identifier: UA54373
2026-01-27 21:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392
2026-01-27 21:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f44fa3-4830-5dc3-b239-fc067a92eda3 with scrape type 2
2026-01-27 21:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f44fa3-4830-5dc3-b239-fc067a92eda3 with scrape type 2
2026-01-27 21:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 48f44fa3-4830-5dc3-b239-fc067a92eda3, identifier: XW74392
2026-01-27 21:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-01-27 21:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c94059-c0dc-5c7b-b872-9af3291319e9 with scrape type 2
2026-01-27 21:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1c94059-c0dc-5c7b-b872-9af3291319e9 with scrape type 2
2026-01-27 21:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1c94059-c0dc-5c7b-b872-9af3291319e9, identifier: AR75288
2026-01-27 21:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with identifier: NK32002
2026-01-27 21:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with scrape type 2
2026-01-27 21:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with scrape type 2
2026-01-27 21:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4, identifier: NK32002
2026-01-27 21:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373
2026-01-27 21:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373
2026-01-27 21:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373 to the API
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA54373>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:36:05Z',
'fuel_type': 'petrol',
'id': 'b873199b-b674-58c3-9642-d8f715c5f2d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA54373',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 51614,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2022}
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2026-01-27 21:02:49 [auto1.it] INFO: Saving data for UA54373: {'auction_closing_time': 1769618165.0, 'created_time': 1769076389.810701, 'last_price_update_time': 1769547769.689349}
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA54373') HTTP/1.1" 204 0
2026-01-27 21:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392
2026-01-27 21:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392
2026-01-27 21:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 48f44fa3-4830-5dc3-b239-fc067a92eda3 with identifier: XW74392 to the API
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XW74392>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-01-28T16:22:05Z',
'fuel_type': 'petrol',
'id': '48f44fa3-4830-5dc3-b239-fc067a92eda3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW74392',
'listing': 'auction',
'location': 'IT, Gallarate',
'make': 'Peugeot',
'model': '2008',
'odometer': 27016,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Active Pack',
'transmission': 'automatic',
'trim': 'Active Pack',
'year': 2021}
2026-01-27 21:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW74392%27 HTTP/1.1" 200 None
2026-01-27 21:02:50 [auto1.it] INFO: Saving data for XW74392: {'auction_closing_time': 1769617325.0, 'created_time': 1769458381.404918, 'last_price_update_time': 1769547770.035166}
2026-01-27 21:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW74392') HTTP/1.1" 204 0
2026-01-27 21:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-01-27 21:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-01-27 21:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288 to the API
2026-01-27 21:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR75288>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-01-28T16:26:23Z',
'fuel_type': 'petrol',
'id': 'a1c94059-c0dc-5c7b-b872-9af3291319e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR75288',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Renault',
'model': 'Captur',
'odometer': 15433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Mild-Hybrid Techno',
'transmission': 'manual',
'trim': 'Techno',
'year': 2023}
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-01-27 21:02:51 [auto1.it] INFO: Saving data for AR75288: {'auction_closing_time': 1769617583.0, 'created_time': 1769458301.93419, 'last_price_update_time': 1769547771.068791}
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR75288') HTTP/1.1" 204 0
2026-01-27 21:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with identifier: NK32002
2026-01-27 21:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 with identifier: NK32002
2026-01-27 21:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189728 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
189728
2026-01-27 21:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 spider: auto1.it
2026-01-27 21:02:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 767e7ce0-dc20-5b24-8c23-b2d5f3a803d4 due to rule: high_mileage_for_country.json, error: 189728 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
189728
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 286,
'expiration_date': '2026-01-28T16:37:30Z',
'fuel_type': 'diesel',
'id': '767e7ce0-dc20-5b24-8c23-b2d5f3a803d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK32002',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 189728,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK32002%27 HTTP/1.1" 200 None
2026-01-27 21:02:51 [auto1.it] INFO: Saving data for NK32002: {'auction_closing_time': 1769618250.0, 'created_time': 1768471730.837392, 'last_price_update_time': 1769547771.302855}
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK32002') HTTP/1.1" 204 0
2026-01-27 21:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX93574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN85352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA86340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE39757/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM38508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD79561> (referer: https://www.auto1.com/v1/car-details-view/CD79561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:52 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: YK03588
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK03588%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for YK03588: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: MX37166
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX37166%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for MX37166: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: GY37830
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY37830%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for GY37830: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: TF80780
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF80780%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for TF80780: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: ZY33517
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY33517%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for ZY33517: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: YC62647
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC62647%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for YC62647: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: ZP66012
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66012%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for ZP66012: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: GA88352
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA88352%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for GA88352: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: EX13781
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX13781%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for EX13781: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: BE02866
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE02866%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for BE02866: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: UD44278
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD44278%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for UD44278: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: SE73703
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE73703%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for SE73703: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: FD29488
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD29488%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for FD29488: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: LX50050
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX50050%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for LX50050: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: WA99422
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA99422%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for WA99422: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: VU47958
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU47958%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for VU47958: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: PW60700
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW60700%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for PW60700: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: XL18907
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL18907%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for XL18907: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: RW28889
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW28889%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for RW28889: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: XH67848
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH67848%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for XH67848: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: AU30700
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU30700%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for AU30700: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: DC75270
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC75270%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for DC75270: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: GL72110
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL72110%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for GL72110: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: VJ46302
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ46302%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for VJ46302: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: BK29773
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK29773%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for BK29773: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: WR93910
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR93910%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for WR93910: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: NF65001
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF65001%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for NF65001: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: HW19306
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW19306%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for HW19306: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: WZ98003
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ98003%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for WZ98003: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: KR39875
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR39875%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for KR39875: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: DS86175
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS86175%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for DS86175: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: KE23075
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE23075%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for KE23075: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: AP06921
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP06921%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for AP06921: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: LA75896
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA75896%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for LA75896: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: FR60172
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR60172%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for FR60172: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: UY53299
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY53299%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for UY53299: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: MG24546
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG24546%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for MG24546: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: CG22927
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG22927%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for CG22927: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: TC41624
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC41624%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for TC41624: 0
2026-01-27 21:02:52 [auto1.it] INFO: Found listing with ID: EN89952
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN89952%27 HTTP/1.1" 200 None
2026-01-27 21:02:52 [auto1.it] INFO: Scrape type for EN89952: 0
2026-01-27 21:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ25733> (referer: https://www.auto1.com/v1/car-details-view/MJ25733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW51000> (referer: https://www.auto1.com/v1/car-details-view/UW51000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL96089> (referer: https://www.auto1.com/v1/car-details-view/XL96089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561
2026-01-27 21:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c957701f-fda9-5198-a6ad-e712a85fa29c with scrape type 2
2026-01-27 21:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c957701f-fda9-5198-a6ad-e712a85fa29c with scrape type 2
2026-01-27 21:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c957701f-fda9-5198-a6ad-e712a85fa29c, identifier: CD79561
2026-01-27 21:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561
2026-01-27 21:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561
2026-01-27 21:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c957701f-fda9-5198-a6ad-e712a85fa29c with identifier: CD79561 to the API
2026-01-27 21:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD79561>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2026-01-28T16:58:55Z',
'fuel_type': 'hybrid',
'id': 'c957701f-fda9-5198-a6ad-e712a85fa29c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD79561',
'listing': 'auction',
'location': 'IT, Rivalta di Torino (TO)',
'make': 'Peugeot',
'model': '3008',
'odometer': 70865,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
'transmission': 'automatic',
'trim': 'GT Pack',
'year': 2021}
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-27 21:02:54 [auto1.it] INFO: Saving data for CD79561: {'auction_closing_time': 1769619535.0, 'created_time': 1769458454.58264, 'last_price_update_time': 1769547774.066297}
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD79561') HTTP/1.1" 204 0
2026-01-27 21:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB07177> (referer: https://www.auto1.com/v1/car-details-view/GB07177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET25388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL10790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b05f1aa-dc78-5904-8980-078cca368d49 with identifier: MJ25733
2026-01-27 21:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b05f1aa-dc78-5904-8980-078cca368d49 with scrape type 2
2026-01-27 21:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b05f1aa-dc78-5904-8980-078cca368d49 with scrape type 2
2026-01-27 21:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9b05f1aa-dc78-5904-8980-078cca368d49, identifier: MJ25733
2026-01-27 21:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000
2026-01-27 21:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with scrape type 2
2026-01-27 21:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with scrape type 2
2026-01-27 21:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e988eac0-5b86-5841-8ad8-467e6ce3f2e0, identifier: UW51000
2026-01-27 21:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fde3ada-bff7-59f4-afd8-fb62851eedfe with identifier: XL96089
2026-01-27 21:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fde3ada-bff7-59f4-afd8-fb62851eedfe with scrape type 2
2026-01-27 21:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fde3ada-bff7-59f4-afd8-fb62851eedfe with scrape type 2
2026-01-27 21:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6fde3ada-bff7-59f4-afd8-fb62851eedfe, identifier: XL96089
2026-01-27 21:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9b05f1aa-dc78-5904-8980-078cca368d49 with identifier: MJ25733
2026-01-27 21:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9b05f1aa-dc78-5904-8980-078cca368d49 with identifier: MJ25733
2026-01-27 21:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9b05f1aa-dc78-5904-8980-078cca368d49 with identifier: MJ25733 to the API
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MJ25733>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 162,
'expiration_date': '2026-01-28T16:38:08Z',
'fuel_type': 'petrol',
'id': '9b05f1aa-dc78-5904-8980-078cca368d49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ25733',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'MG',
'model': 'HS',
'odometer': 35971,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'MG HS 1.5 Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2024}
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ25733%27 HTTP/1.1" 200 None
2026-01-27 21:02:54 [auto1.it] INFO: Saving data for MJ25733: {'auction_closing_time': 1769618288.0, 'created_time': 1768939449.00108, 'last_price_update_time': 1769547774.770446}
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ25733') HTTP/1.1" 204 0
2026-01-27 21:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000
2026-01-27 21:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000
2026-01-27 21:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e988eac0-5b86-5841-8ad8-467e6ce3f2e0 with identifier: UW51000 to the API
2026-01-27 21:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW51000>
{'auction_title': '',
'c_o_2_emission_value': 1,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.3L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:21:43Z',
'fuel_type': 'petrol',
'id': 'e988eac0-5b86-5841-8ad8-467e6ce3f2e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW51000',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 64467,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-16',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.3 TGDi Limited 4x2',
'transmission': 'automatic',
'trim': 'Limited 4x2',
'year': 2018}
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW51000%27 HTTP/1.1" 200 None
2026-01-27 21:02:55 [auto1.it] INFO: Saving data for UW51000: {'auction_closing_time': 1769617303.0, 'created_time': 1769458274.251314, 'last_price_update_time': 1769547775.613301}
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW51000') HTTP/1.1" 204 0
2026-01-27 21:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6fde3ada-bff7-59f4-afd8-fb62851eedfe with identifier: XL96089
2026-01-27 21:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6fde3ada-bff7-59f4-afd8-fb62851eedfe with identifier: XL96089
2026-01-27 21:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6fde3ada-bff7-59f4-afd8-fb62851eedfe with identifier: XL96089 to the API
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL96089>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 114,
'expiration_date': '2026-01-28T16:40:49Z',
'fuel_type': 'gas',
'id': '6fde3ada-bff7-59f4-afd8-fb62851eedfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL96089',
'listing': 'auction',
'location': 'IT, Latina',
'make': 'DR',
'model': 'DR 5.0',
'odometer': 45585,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 5.0 1.5 LPG',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL96089%27 HTTP/1.1" 200 None
2026-01-27 21:02:55 [auto1.it] INFO: Saving data for XL96089: {'auction_closing_time': 1769618449.0, 'created_time': 1769458076.273721, 'last_price_update_time': 1769547775.922288}
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL96089') HTTP/1.1" 204 0
2026-01-27 21:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ58430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA25408> (referer: https://www.auto1.com/v1/car-details-view/RA25408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47997c4d-5841-549b-965d-b703b6fdfa00 with identifier: GB07177
2026-01-27 21:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47997c4d-5841-549b-965d-b703b6fdfa00 with scrape type 2
2026-01-27 21:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47997c4d-5841-549b-965d-b703b6fdfa00 with scrape type 2
2026-01-27 21:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47997c4d-5841-549b-965d-b703b6fdfa00, identifier: GB07177
2026-01-27 21:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47997c4d-5841-549b-965d-b703b6fdfa00 with identifier: GB07177
2026-01-27 21:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47997c4d-5841-549b-965d-b703b6fdfa00 with identifier: GB07177
2026-01-27 21:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-27 21:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 47997c4d-5841-549b-965d-b703b6fdfa00 spider: auto1.it
2026-01-27 21:02:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 47997c4d-5841-549b-965d-b703b6fdfa00 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-01-28T16:34:22Z',
'fuel_type': 'diesel',
'id': '47997c4d-5841-549b-965d-b703b6fdfa00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB07177',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Renault',
'model': 'Express',
'odometer': 8906,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-26',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Express 1.5 BLUE dCi Extra',
'transmission': 'manual',
'trim': 'Extra',
'year': 2023}
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB07177%27 HTTP/1.1" 200 None
2026-01-27 21:02:56 [auto1.it] INFO: Saving data for GB07177: {'auction_closing_time': 1769618062.0, 'created_time': 1769458093.240105, 'last_price_update_time': 1769547776.350461}
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB07177') HTTP/1.1" 204 0
2026-01-27 21:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-01-27 21:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 2
2026-01-27 21:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 2
2026-01-27 21:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 741d7026-0aac-5c3b-8af5-ab758388ede6, identifier: RA25408
2026-01-27 21:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-01-27 21:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-01-27 21:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408 to the API
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA25408>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 230,
'expiration_date': '2026-01-28T16:10:03Z',
'fuel_type': 'hybrid',
'id': '741d7026-0aac-5c3b-8af5-ab758388ede6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA25408',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 81577,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
'transmission': 'automatic',
'trim': 'XLine 2WD',
'year': 2023}
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-01-27 21:02:56 [auto1.it] INFO: Saving data for RA25408: {'auction_closing_time': 1769616603.0, 'created_time': 1769458305.191988, 'last_price_update_time': 1769547776.798407}
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA25408') HTTP/1.1" 204 0
2026-01-27 21:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG00560> (referer: https://www.auto1.com/v1/car-details-view/HG00560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD03373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW52947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560
2026-01-27 21:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e21abc-a1cc-5ec9-9b7a-7a780869191e with scrape type 2
2026-01-27 21:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13e21abc-a1cc-5ec9-9b7a-7a780869191e with scrape type 2
2026-01-27 21:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13e21abc-a1cc-5ec9-9b7a-7a780869191e, identifier: HG00560
2026-01-27 21:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560
2026-01-27 21:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560
2026-01-27 21:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13e21abc-a1cc-5ec9-9b7a-7a780869191e with identifier: HG00560 to the API
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HG00560>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:05:17Z',
'fuel_type': 'gas',
'id': '13e21abc-a1cc-5ec9-9b7a-7a780869191e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG00560',
'listing': 'auction',
'location': 'Pompei',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 81444,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG00560%27 HTTP/1.1" 200 None
2026-01-27 21:02:57 [auto1.it] INFO: Saving data for HG00560: {'auction_closing_time': 1769616317.0, 'created_time': 1769457795.431298, 'last_price_update_time': 1769547777.345082}
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG00560') HTTP/1.1" 204 0
2026-01-27 21:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE15416> (referer: https://www.auto1.com/v1/car-details-view/JE15416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX93574> (referer: https://www.auto1.com/v1/car-details-view/XX93574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN85352> (referer: https://www.auto1.com/v1/car-details-view/EN85352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ77848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416
2026-01-27 21:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35f0081-c6f4-5835-a4c6-470e85808eab with scrape type 2
2026-01-27 21:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d35f0081-c6f4-5835-a4c6-470e85808eab with scrape type 2
2026-01-27 21:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d35f0081-c6f4-5835-a4c6-470e85808eab, identifier: JE15416
2026-01-27 21:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416
2026-01-27 21:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416
2026-01-27 21:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d35f0081-c6f4-5835-a4c6-470e85808eab with identifier: JE15416 to the API
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE15416>
{'auction_title': '',
'c_o_2_emission_value': 199,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 300,
'expiration_date': '2026-01-28T16:38:47Z',
'fuel_type': 'petrol',
'id': 'd35f0081-c6f4-5835-a4c6-470e85808eab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE15416',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 55595,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2022}
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE15416%27 HTTP/1.1" 200 None
2026-01-27 21:02:57 [auto1.it] INFO: Saving data for JE15416: {'auction_closing_time': 1769618327.0, 'created_time': 1769026102.86481, 'last_price_update_time': 1769547777.875436}
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE15416') HTTP/1.1" 204 0
2026-01-27 21:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU61631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3714ede-7433-5465-a2e2-3e71a2829804 with identifier: XX93574
2026-01-27 21:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3714ede-7433-5465-a2e2-3e71a2829804 with scrape type 2
2026-01-27 21:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3714ede-7433-5465-a2e2-3e71a2829804 with scrape type 2
2026-01-27 21:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3714ede-7433-5465-a2e2-3e71a2829804, identifier: XX93574
2026-01-27 21:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352
2026-01-27 21:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f07141ec-2729-5808-b041-bc1279a3fe66 with scrape type 2
2026-01-27 21:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f07141ec-2729-5808-b041-bc1279a3fe66 with scrape type 2
2026-01-27 21:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f07141ec-2729-5808-b041-bc1279a3fe66, identifier: EN85352
2026-01-27 21:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3714ede-7433-5465-a2e2-3e71a2829804 with identifier: XX93574
2026-01-27 21:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3714ede-7433-5465-a2e2-3e71a2829804 with identifier: XX93574
2026-01-27 21:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177134 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
177134
2026-01-27 21:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f3714ede-7433-5465-a2e2-3e71a2829804 spider: auto1.it
2026-01-27 21:02:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f3714ede-7433-5465-a2e2-3e71a2829804 due to rule: high_mileage_for_country.json, error: 177134 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
177134
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:27:20Z',
'fuel_type': 'diesel',
'id': 'f3714ede-7433-5465-a2e2-3e71a2829804',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX93574',
'listing': 'auction',
'location': 'IT, Feriolo',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 177134,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Advance 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Advance 4Motion BlueMotion',
'year': 2019}
2026-01-27 21:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93574%27 HTTP/1.1" 200 None
2026-01-27 21:02:58 [auto1.it] INFO: Saving data for XX93574: {'auction_closing_time': 1769617640.0, 'created_time': 1769457767.488553, 'last_price_update_time': 1769547778.30845}
2026-01-27 21:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX93574') HTTP/1.1" 204 0
2026-01-27 21:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352
2026-01-27 21:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352
2026-01-27 21:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f07141ec-2729-5808-b041-bc1279a3fe66 with identifier: EN85352 to the API
2026-01-27 21:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN85352>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-01-28T16:52:39Z',
'fuel_type': 'diesel',
'id': 'f07141ec-2729-5808-b041-bc1279a3fe66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN85352',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 94633,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport D150 Mild-Hybrid Business AWD',
'transmission': 'automatic',
'trim': 'Business AWD',
'year': 2020}
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN85352%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Saving data for EN85352: {'auction_closing_time': 1769619159.0, 'created_time': 1768471325.786649, 'last_price_update_time': 1769547779.079705}
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN85352') HTTP/1.1" 204 0
2026-01-27 21:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE39757> (referer: https://www.auto1.com/v1/car-details-view/RE39757/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM38508> (referer: https://www.auto1.com/v1/car-details-view/NM38508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:02:59 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: LC41614
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC41614%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for LC41614: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: FA85590
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA85590%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for FA85590: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: NT83808
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT83808%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for NT83808: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: XX48946
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX48946%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for XX48946: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: SY35335
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY35335%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for SY35335: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: NR19690
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19690%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for NR19690: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: HF33794
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF33794%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for HF33794: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: PW04217
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW04217%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for PW04217: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: JZ99891
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ99891%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for JZ99891: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: SN76439
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN76439%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for SN76439: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: LE26048
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE26048%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for LE26048: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: RZ37041
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ37041%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for RZ37041: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: VJ87382
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ87382%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for VJ87382: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: WZ58856
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ58856%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for WZ58856: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: FS57712
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS57712%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for FS57712: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: JB07830
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB07830%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for JB07830: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: GY55011
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for GY55011: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: MC45094
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC45094%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for MC45094: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: CJ96315
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ96315%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for CJ96315: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: GW95975
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW95975%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for GW95975: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: UH26467
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH26467%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for UH26467: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: DM37536
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM37536%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for DM37536: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: KG82335
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG82335%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for KG82335: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: FD77892
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD77892%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for FD77892: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: VS63491
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63491%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for VS63491: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: BP11970
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP11970%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for BP11970: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: CM86326
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM86326%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for CM86326: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: MB19199
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB19199%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for MB19199: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: VK27211
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK27211%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for VK27211: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: DH39383
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH39383%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for DH39383: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: HT61249
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT61249%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for HT61249: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: DP80955
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP80955%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for DP80955: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: TB86864
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB86864%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for TB86864: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: GC68845
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC68845%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for GC68845: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: TS13156
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS13156%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for TS13156: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: ZN65600
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN65600%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for ZN65600: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: JL50472
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL50472%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for JL50472: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: KU06589
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU06589%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for KU06589: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: AL67393
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL67393%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for AL67393: 0
2026-01-27 21:02:59 [auto1.it] INFO: Found listing with ID: LT93691
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT93691%27 HTTP/1.1" 200 None
2026-01-27 21:02:59 [auto1.it] INFO: Scrape type for LT93691: 0
2026-01-27 21:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f4c282-0de4-5bde-944e-e213a5d5ad9b with identifier: RE39757
2026-01-27 21:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f4c282-0de4-5bde-944e-e213a5d5ad9b with scrape type 2
2026-01-27 21:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f4c282-0de4-5bde-944e-e213a5d5ad9b with scrape type 2
2026-01-27 21:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12f4c282-0de4-5bde-944e-e213a5d5ad9b, identifier: RE39757
2026-01-27 21:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33 with identifier: NM38508
2026-01-27 21:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33 with scrape type 2
2026-01-27 21:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33 with scrape type 2
2026-01-27 21:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33, identifier: NM38508
2026-01-27 21:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12f4c282-0de4-5bde-944e-e213a5d5ad9b with identifier: RE39757
2026-01-27 21:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12f4c282-0de4-5bde-944e-e213a5d5ad9b with identifier: RE39757
2026-01-27 21:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-27 21:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 12f4c282-0de4-5bde-944e-e213a5d5ad9b spider: auto1.it
2026-01-27 21:03:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 12f4c282-0de4-5bde-944e-e213a5d5ad9b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-01-28T16:55:41Z',
'fuel_type': 'petrol',
'id': '12f4c282-0de4-5bde-944e-e213a5d5ad9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE39757',
'listing': 'auction',
'location': 'Villasanta',
'make': 'Fiat',
'model': 'Panda',
'odometer': 17388,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2020}
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE39757%27 HTTP/1.1" 200 None
2026-01-27 21:03:00 [auto1.it] INFO: Saving data for RE39757: {'auction_closing_time': 1769619341.0, 'created_time': 1769457911.950911, 'last_price_update_time': 1769547780.398334}
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE39757') HTTP/1.1" 204 0
2026-01-27 21:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33 with identifier: NM38508
2026-01-27 21:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33 with identifier: NM38508
2026-01-27 21:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163598 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163598
2026-01-27 21:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33 spider: auto1.it
2026-01-27 21:03:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3c3ffdfe-85eb-5fc7-b31a-97aea593ea33 due to rule: high_mileage_for_country.json, error: 163598 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163598
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-01-28T16:30:42Z',
'fuel_type': 'diesel',
'id': '3c3ffdfe-85eb-5fc7-b31a-97aea593ea33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM38508',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Kia',
'model': 'Sportage',
'odometer': 163598,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Energy 2WD',
'transmission': 'automatic',
'trim': 'Energy 2WD',
'year': 2018}
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM38508%27 HTTP/1.1" 200 None
2026-01-27 21:03:00 [auto1.it] INFO: Saving data for NM38508: {'auction_closing_time': 1769617842.0, 'created_time': 1769458424.55345, 'last_price_update_time': 1769547780.726415}
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NM38508') HTTP/1.1" 204 0
2026-01-27 21:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA86340> (referer: https://www.auto1.com/v1/car-details-view/CA86340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL10790> (referer: https://www.auto1.com/v1/car-details-view/HL10790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ58430> (referer: https://www.auto1.com/v1/car-details-view/TZ58430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET25388> (referer: https://www.auto1.com/v1/car-details-view/ET25388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340
2026-01-27 21:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with scrape type 2
2026-01-27 21:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with scrape type 2
2026-01-27 21:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d0e744a-dbea-5b75-a37e-68c6ad74b497, identifier: CA86340
2026-01-27 21:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afe66b5-03ee-53ff-a630-833c4d68d659 with identifier: HL10790
2026-01-27 21:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afe66b5-03ee-53ff-a630-833c4d68d659 with scrape type 2
2026-01-27 21:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2afe66b5-03ee-53ff-a630-833c4d68d659 with scrape type 2
2026-01-27 21:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2afe66b5-03ee-53ff-a630-833c4d68d659, identifier: HL10790
2026-01-27 21:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430
2026-01-27 21:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20a24d4d-ffe8-54f8-9ddd-191411709da7 with scrape type 2
2026-01-27 21:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20a24d4d-ffe8-54f8-9ddd-191411709da7 with scrape type 2
2026-01-27 21:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20a24d4d-ffe8-54f8-9ddd-191411709da7, identifier: TZ58430
2026-01-27 21:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340
2026-01-27 21:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340
2026-01-27 21:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d0e744a-dbea-5b75-a37e-68c6ad74b497 with identifier: CA86340 to the API
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA86340>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-01-28T16:58:44Z',
'fuel_type': 'petrol',
'id': '1d0e744a-dbea-5b75-a37e-68c6ad74b497',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA86340',
'listing': 'auction',
'location': 'IT, Legnano',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 8560,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Summit',
'transmission': 'manual',
'trim': 'Summit',
'year': 2024}
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA86340%27 HTTP/1.1" 200 None
2026-01-27 21:03:01 [auto1.it] INFO: Saving data for CA86340: {'auction_closing_time': 1769619524.0, 'created_time': 1769457703.772396, 'last_price_update_time': 1769547781.491591}
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA86340') HTTP/1.1" 204 0
2026-01-27 21:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2afe66b5-03ee-53ff-a630-833c4d68d659 with identifier: HL10790
2026-01-27 21:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2afe66b5-03ee-53ff-a630-833c4d68d659 with identifier: HL10790
2026-01-27 21:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2afe66b5-03ee-53ff-a630-833c4d68d659 with identifier: HL10790 to the API
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL10790>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 160,
'expiration_date': '2026-01-28T16:49:20Z',
'fuel_type': 'diesel',
'id': '2afe66b5-03ee-53ff-a630-833c4d68d659',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL10790',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 62202,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d T Sport Plus',
'transmission': 'automatic',
'trim': 'T Sport Plus',
'year': 2021}
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL10790%27 HTTP/1.1" 200 None
2026-01-27 21:03:01 [auto1.it] INFO: Saving data for HL10790: {'auction_closing_time': 1769618960.0, 'created_time': 1769458014.445928, 'last_price_update_time': 1769547781.824179}
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL10790') HTTP/1.1" 204 0
2026-01-27 21:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430
2026-01-27 21:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430
2026-01-27 21:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430 to the API
2026-01-27 21:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ58430>
{'auction_title': '',
'c_o_2_emission_value': 204,
'category': 'Rental',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 333,
'expiration_date': '2026-01-28T16:42:06Z',
'fuel_type': 'petrol',
'id': '20a24d4d-ffe8-54f8-9ddd-191411709da7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ58430',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'BMW',
'model': '8er',
'odometer': 101539,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 8er 840i Gran Coupe Mild-Hybrid xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2022}
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ58430%27 HTTP/1.1" 200 None
2026-01-27 21:03:02 [auto1.it] INFO: Saving data for TZ58430: {'auction_closing_time': 1769618526.0, 'created_time': 1769458258.433927, 'last_price_update_time': 1769547782.157421}
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ58430') HTTP/1.1" 204 0
2026-01-27 21:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388
2026-01-27 21:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 023fb0bc-1406-518c-a2e7-c65bb6238be5 with scrape type 2
2026-01-27 21:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 023fb0bc-1406-518c-a2e7-c65bb6238be5 with scrape type 2
2026-01-27 21:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 023fb0bc-1406-518c-a2e7-c65bb6238be5, identifier: ET25388
2026-01-27 21:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW52947> (referer: https://www.auto1.com/v1/car-details-view/TW52947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388
2026-01-27 21:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388
2026-01-27 21:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 023fb0bc-1406-518c-a2e7-c65bb6238be5 with identifier: ET25388 to the API
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ET25388>
{'auction_title': '',
'c_o_2_emission_value': 178,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 249,
'expiration_date': '2026-01-28T16:22:11Z',
'fuel_type': 'diesel',
'id': '023fb0bc-1406-518c-a2e7-c65bb6238be5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET25388',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Volvo',
'model': 'XC90',
'odometer': 97678,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-14',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Momentum Pro AWD',
'transmission': 'automatic',
'trim': 'Momentum Pro AWD',
'year': 2021}
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET25388%27 HTTP/1.1" 200 None
2026-01-27 21:03:02 [auto1.it] INFO: Saving data for ET25388: {'auction_closing_time': 1769617331.0, 'created_time': 1769025995.659601, 'last_price_update_time': 1769547782.585519}
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET25388') HTTP/1.1" 204 0
2026-01-27 21:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4fbfb80-04b5-5382-82e4-0c33111ff8be with identifier: TW52947
2026-01-27 21:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fbfb80-04b5-5382-82e4-0c33111ff8be with scrape type 2
2026-01-27 21:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4fbfb80-04b5-5382-82e4-0c33111ff8be with scrape type 2
2026-01-27 21:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4fbfb80-04b5-5382-82e4-0c33111ff8be, identifier: TW52947
2026-01-27 21:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4fbfb80-04b5-5382-82e4-0c33111ff8be with identifier: TW52947
2026-01-27 21:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4fbfb80-04b5-5382-82e4-0c33111ff8be with identifier: TW52947
2026-01-27 21:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4fbfb80-04b5-5382-82e4-0c33111ff8be with identifier: TW52947 to the API
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW52947>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-01-28T16:10:46Z',
'fuel_type': 'diesel',
'id': 'd4fbfb80-04b5-5382-82e4-0c33111ff8be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW52947',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Jeep',
'model': 'Compass',
'odometer': 133915,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2019}
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW52947%27 HTTP/1.1" 200 None
2026-01-27 21:03:03 [auto1.it] INFO: Saving data for TW52947: {'auction_closing_time': 1769616646.0, 'created_time': 1769457999.478957, 'last_price_update_time': 1769547783.053194}
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW52947') HTTP/1.1" 204 0
2026-01-27 21:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD03373> (referer: https://www.auto1.com/v1/car-details-view/AD03373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU61631> (referer: https://www.auto1.com/v1/car-details-view/XU61631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ77848> (referer: https://www.auto1.com/v1/car-details-view/SJ77848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373
2026-01-27 21:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e072f5ed-b58e-5ea6-b241-144ee9453283 with scrape type 2
2026-01-27 21:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e072f5ed-b58e-5ea6-b241-144ee9453283 with scrape type 2
2026-01-27 21:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e072f5ed-b58e-5ea6-b241-144ee9453283, identifier: AD03373
2026-01-27 21:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with identifier: XU61631
2026-01-27 21:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with scrape type 2
2026-01-27 21:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with scrape type 2
2026-01-27 21:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab, identifier: XU61631
2026-01-27 21:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb0bf675-045c-55bf-92fe-504461fd6d4c with identifier: SJ77848
2026-01-27 21:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb0bf675-045c-55bf-92fe-504461fd6d4c with scrape type 2
2026-01-27 21:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb0bf675-045c-55bf-92fe-504461fd6d4c with scrape type 2
2026-01-27 21:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb0bf675-045c-55bf-92fe-504461fd6d4c, identifier: SJ77848
2026-01-27 21:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373
2026-01-27 21:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373
2026-01-27 21:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e072f5ed-b58e-5ea6-b241-144ee9453283 with identifier: AD03373 to the API
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD03373>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 194,
'expiration_date': '2026-01-28T16:18:29Z',
'fuel_type': 'diesel',
'id': 'e072f5ed-b58e-5ea6-b241-144ee9453283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD03373',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 86620,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2021}
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD03373%27 HTTP/1.1" 200 None
2026-01-27 21:03:03 [auto1.it] INFO: Saving data for AD03373: {'auction_closing_time': 1769617109.0, 'created_time': 1769026047.487081, 'last_price_update_time': 1769547783.882091}
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AD03373') HTTP/1.1" 204 0
2026-01-27 21:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with identifier: XU61631
2026-01-27 21:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab with identifier: XU61631
2026-01-27 21:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172314 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172314
2026-01-27 21:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab spider: auto1.it
2026-01-27 21:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c1bbb563-8181-5dc8-bf5e-ef35676ed9ab due to rule: high_mileage_for_country.json, error: 172314 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172314
{'auction_title': '',
'c_o_2_emission_value': 34,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2026-01-28T16:40:54Z',
'fuel_type': 'hybrid',
'id': 'c1bbb563-8181-5dc8-bf5e-ef35676ed9ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU61631',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 172314,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-07',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid Business 4x4',
'transmission': 'automatic',
'trim': 'Business 4x4',
'year': 2020}
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU61631%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Saving data for XU61631: {'auction_closing_time': 1769618454.0, 'created_time': 1768248389.604365, 'last_price_update_time': 1769547784.104588}
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU61631') HTTP/1.1" 204 0
2026-01-27 21:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb0bf675-045c-55bf-92fe-504461fd6d4c with identifier: SJ77848
2026-01-27 21:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb0bf675-045c-55bf-92fe-504461fd6d4c with identifier: SJ77848
2026-01-27 21:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195503 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195503
2026-01-27 21:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bb0bf675-045c-55bf-92fe-504461fd6d4c spider: auto1.it
2026-01-27 21:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bb0bf675-045c-55bf-92fe-504461fd6d4c due to rule: high_mileage_for_country.json, error: 195503 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195503
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-01-28T16:22:27Z',
'fuel_type': 'diesel',
'id': 'bb0bf675-045c-55bf-92fe-504461fd6d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ77848',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 195503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2020}
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ77848%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Saving data for SJ77848: {'auction_closing_time': 1769617347.0, 'created_time': 1769457982.489855, 'last_price_update_time': 1769547784.332673}
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ77848') HTTP/1.1" 204 0
2026-01-27 21:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:04 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: FR59611
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR59611%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for FR59611: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: EZ39176
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ39176%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for EZ39176: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: AS00040
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS00040%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for AS00040: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: BD06360
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD06360%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for BD06360: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: BY77891
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY77891%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for BY77891: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: FD61613
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD61613%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for FD61613: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: SW85774
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW85774%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for SW85774: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: YA41341
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA41341%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for YA41341: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: LB25725
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB25725%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for LB25725: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: WY47347
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY47347%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for WY47347: 2
2026-01-27 21:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: NF99707
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99707%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for NF99707: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: RD80125
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD80125%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for RD80125: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: UU64650
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64650%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for UU64650: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: PH37859
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH37859%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for PH37859: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: GN66049
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN66049%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for GN66049: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: VT26842
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT26842%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for VT26842: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: YB28546
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB28546%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for YB28546: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: LX29596
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX29596%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for LX29596: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: UZ59639
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ59639%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for UZ59639: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: TP54154
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP54154%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for TP54154: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: TJ53755
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ53755%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for TJ53755: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: YZ33678
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ33678%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for YZ33678: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: CB54413
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB54413%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for CB54413: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: BW17838
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW17838%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for BW17838: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: FM65684
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM65684%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for FM65684: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: BL99531
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL99531%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for BL99531: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: TP30511
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP30511%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for TP30511: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: CN56485
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN56485%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for CN56485: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: ES13575
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES13575%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for ES13575: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: XG77213
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG77213%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for XG77213: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: CW51331
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW51331%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for CW51331: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: JP77567
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP77567%27 HTTP/1.1" 200 None
2026-01-27 21:03:04 [auto1.it] INFO: Scrape type for JP77567: 0
2026-01-27 21:03:04 [auto1.it] INFO: Found listing with ID: UT25383
2026-01-27 21:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT25383%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for UT25383: 0
2026-01-27 21:03:05 [auto1.it] INFO: Found listing with ID: MD11122
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD11122%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for MD11122: 0
2026-01-27 21:03:05 [auto1.it] INFO: Found listing with ID: TP56886
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP56886%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for TP56886: 0
2026-01-27 21:03:05 [auto1.it] INFO: Found listing with ID: HX56928
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX56928%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for HX56928: 0
2026-01-27 21:03:05 [auto1.it] INFO: Found listing with ID: WT86652
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT86652%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for WT86652: 0
2026-01-27 21:03:05 [auto1.it] INFO: Found listing with ID: LN41021
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN41021%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for LN41021: 0
2026-01-27 21:03:05 [auto1.it] INFO: Found listing with ID: TS00967
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS00967%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for TS00967: 0
2026-01-27 21:03:05 [auto1.it] INFO: Found listing with ID: SW68583
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW68583%27 HTTP/1.1" 200 None
2026-01-27 21:03:05 [auto1.it] INFO: Scrape type for SW68583: 0
2026-01-27 21:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY47347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:06 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: NB38092
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB38092%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for NB38092: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: JG91942
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG91942%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for JG91942: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: NN35046
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN35046%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for NN35046: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: GX74312
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX74312%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for GX74312: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: AD68193
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD68193%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for AD68193: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: NL34608
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL34608%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for NL34608: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: SK32602
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK32602%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for SK32602: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: LD62030
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD62030%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for LD62030: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: XF74910
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF74910%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for XF74910: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: XJ76897
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ76897%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for XJ76897: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: LB98702
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB98702%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for LB98702: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: RJ83517
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ83517%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for RJ83517: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: KN31697
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN31697%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for KN31697: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: FF86857
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF86857%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for FF86857: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: SA07653
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA07653%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for SA07653: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: XH51228
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH51228%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for XH51228: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: YW17704
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW17704%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for YW17704: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: UN61928
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN61928%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for UN61928: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: SC91268
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91268%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for SC91268: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: WT09600
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT09600%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for WT09600: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: BP77320
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP77320%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for BP77320: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: PP34407
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP34407%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for PP34407: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: SD18142
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18142%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for SD18142: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: HD77272
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD77272%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for HD77272: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: AH34632
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH34632%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for AH34632: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: BP48595
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP48595%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for BP48595: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: UC16167
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC16167%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for UC16167: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: FA52335
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA52335%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for FA52335: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: HW78995
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW78995%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for HW78995: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: XP01940
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP01940%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for XP01940: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: XM03029
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for XM03029: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: NK14048
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK14048%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for NK14048: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: JS30214
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS30214%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for JS30214: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: DP76328
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for DP76328: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: VT99729
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT99729%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for VT99729: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: JX72433
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX72433%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for JX72433: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: HE18961
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE18961%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for HE18961: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: SX06852
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX06852%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for SX06852: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: BD24207
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD24207%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for BD24207: 0
2026-01-27 21:03:06 [auto1.it] INFO: Found listing with ID: EN91628
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN91628%27 HTTP/1.1" 200 None
2026-01-27 21:03:06 [auto1.it] INFO: Scrape type for EN91628: 0
2026-01-27 21:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY47347> (referer: https://www.auto1.com/v1/car-details-view/WY47347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347
2026-01-27 21:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with scrape type 2
2026-01-27 21:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with scrape type 2
2026-01-27 21:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96a09505-4f22-555c-a3e2-d8b1b9a6a306, identifier: WY47347
2026-01-27 21:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347
2026-01-27 21:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347
2026-01-27 21:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96a09505-4f22-555c-a3e2-d8b1b9a6a306 with identifier: WY47347 to the API
2026-01-27 21:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 21:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 21:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WY47347>
{'auction_title': '',
'c_o_2_emission_value': 183,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 310,
'expiration_date': '2026-01-28T16:30:32Z',
'fuel_type': 'petrol',
'id': '96a09505-4f22-555c-a3e2-d8b1b9a6a306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY47347',
'listing': 'auction',
'location': 'Desio (MB)',
'make': 'Audi',
'model': 'S3 Sportback',
'odometer': 61552,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Audi S3 Sportback 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2023}
2026-01-27 21:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY47347%27 HTTP/1.1" 200 None
2026-01-27 21:03:07 [auto1.it] INFO: Saving data for WY47347: {'auction_closing_time': 1769617832.0, 'created_time': 1769458441.504155, 'last_price_update_time': 1769547787.556332}
2026-01-27 21:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY47347') HTTP/1.1" 204 0
2026-01-27 21:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:08 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: JD91728
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD91728%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for JD91728: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: BN48518
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for BN48518: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: NL17147
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL17147%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for NL17147: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: DC19441
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC19441%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for DC19441: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: ZZ39119
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ39119%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for ZZ39119: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: AD90482
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD90482%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for AD90482: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: BL38298
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL38298%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for BL38298: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: CE73370
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE73370%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for CE73370: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: SX21988
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21988%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for SX21988: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: HB24915
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB24915%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for HB24915: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: XL62613
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL62613%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for XL62613: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: HZ16886
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ16886%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for HZ16886: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: RR79285
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR79285%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for RR79285: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: FB32798
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB32798%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for FB32798: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: FT64477
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT64477%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for FT64477: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: MU64340
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU64340%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for MU64340: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: TT43912
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT43912%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for TT43912: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: GR20930
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR20930%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for GR20930: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: NC33689
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC33689%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for NC33689: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: LT39464
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT39464%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for LT39464: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: UM24517
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM24517%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for UM24517: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: VJ83989
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ83989%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for VJ83989: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: DZ39731
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ39731%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for DZ39731: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: FX76200
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX76200%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for FX76200: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: GX60446
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX60446%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for GX60446: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: SX30398
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX30398%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for SX30398: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: NV14879
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV14879%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for NV14879: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: BB04771
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB04771%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for BB04771: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: HM97674
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for HM97674: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: UF13738
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for UF13738: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: MJ74552
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ74552%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for MJ74552: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: YB80844
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB80844%27 HTTP/1.1" 200 None
2026-01-27 21:03:08 [auto1.it] INFO: Scrape type for YB80844: 0
2026-01-27 21:03:08 [auto1.it] INFO: Found listing with ID: JK71326
2026-01-27 21:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK71326%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for JK71326: 0
2026-01-27 21:03:09 [auto1.it] INFO: Found listing with ID: KW94897
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW94897%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for KW94897: 0
2026-01-27 21:03:09 [auto1.it] INFO: Found listing with ID: FL81040
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL81040%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for FL81040: 0
2026-01-27 21:03:09 [auto1.it] INFO: Found listing with ID: AZ36136
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ36136%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for AZ36136: 0
2026-01-27 21:03:09 [auto1.it] INFO: Found listing with ID: XR33042
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR33042%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for XR33042: 0
2026-01-27 21:03:09 [auto1.it] INFO: Found listing with ID: LM64931
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM64931%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for LM64931: 0
2026-01-27 21:03:09 [auto1.it] INFO: Found listing with ID: EB83930
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB83930%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for EB83930: 0
2026-01-27 21:03:09 [auto1.it] INFO: Found listing with ID: AK97065
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK97065%27 HTTP/1.1" 200 None
2026-01-27 21:03:09 [auto1.it] INFO: Scrape type for AK97065: 0
2026-01-27 21:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:10 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: ZP16966
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP16966%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for ZP16966: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: GM98091
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM98091%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for GM98091: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: SB54869
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB54869%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for SB54869: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: YU15778
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU15778%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for YU15778: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: GW19210
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW19210%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for GW19210: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: HT84614
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT84614%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for HT84614: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: HG59562
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG59562%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for HG59562: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: RZ04126
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ04126%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for RZ04126: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: WV64596
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV64596%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for WV64596: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: PJ38306
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ38306%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for PJ38306: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: PM64669
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM64669%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for PM64669: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: AV95910
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV95910%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for AV95910: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: UW96033
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96033%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for UW96033: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: GL50499
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL50499%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for GL50499: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: RZ31448
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31448%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for RZ31448: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: FW48614
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW48614%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for FW48614: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: LS33015
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS33015%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for LS33015: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: AV53381
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53381%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for AV53381: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: LL61662
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL61662%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for LL61662: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: PT59724
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT59724%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for PT59724: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: ZC30818
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC30818%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for ZC30818: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: RR68985
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR68985%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for RR68985: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: JM33256
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM33256%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for JM33256: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: GC79469
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC79469%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for GC79469: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: MV48827
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV48827%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for MV48827: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: AK95829
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK95829%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for AK95829: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: TM67998
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM67998%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for TM67998: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: SY04833
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY04833%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for SY04833: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: JA19624
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA19624%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for JA19624: 0
2026-01-27 21:03:10 [auto1.it] INFO: Found listing with ID: UA07437
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA07437%27 HTTP/1.1" 200 None
2026-01-27 21:03:10 [auto1.it] INFO: Scrape type for UA07437: 0
2026-01-27 21:03:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 21:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-27 21:03:11 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-27 21:03:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-27 21:03:11 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 70}
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201769115791 HTTP/1.1" 200 None
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EU90084') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JB91899') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KB73478') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LB27431') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LL27458') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MB57472') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MF45517') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NF23151') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PE88051') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PR83232') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PS20346') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RY80591') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SD38225') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SN18242') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SP65620') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TB91791') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ26905') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UC49322') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UN78611') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UP05392') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='US28662') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UW30396') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ89898') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VE06130') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VX77287') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WM74528') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WP01267') HTTP/1.1" 204 0
2026-01-27 21:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YP02693') HTTP/1.1" 204 0
2026-01-27 21:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZY88685') HTTP/1.1" 204 0
2026-01-27 21:03:12 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (199 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_74_2026-01-27T21_00_00.jl
2026-01-27 21:03:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1214069,
'downloader/request_count': 545,
'downloader/request_method_count/GET': 526,
'downloader/request_method_count/POST': 19,
'downloader/response_bytes': 12801208,
'downloader/response_count': 545,
'downloader/response_status_count/200': 545,
'dupefilter/filtered': 19,
'elapsed_time_seconds': 179.87839,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 1, 27, 21, 3, 12, 3862, tzinfo=datetime.timezone.utc),
'item_dropped_count': 63,
'item_dropped_reasons_count/DropItem': 63,
'item_scraped_count': 199,
'log_count/DEBUG': 4163,
'log_count/INFO': 3645,
'memusage/max': 147398656,
'memusage/startup': 126791680,
'request_depth_max': 20,
'response_received_count': 545,
'scheduler/dequeued': 545,
'scheduler/dequeued/memory': 545,
'scheduler/enqueued': 545,
'scheduler/enqueued/memory': 545,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 545,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.3090414373460417,
'scrapy-zyte-api/mean_response_seconds': 2.3235867533935326,
'scrapy-zyte-api/processed': 545,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 545,
'scrapy-zyte-api/request_args/experimental.requestCookies': 544,
'scrapy-zyte-api/request_args/experimental.responseCookies': 545,
'scrapy-zyte-api/request_args/httpRequestBody': 19,
'scrapy-zyte-api/request_args/httpRequestMethod': 19,
'scrapy-zyte-api/request_args/httpResponseBody': 545,
'scrapy-zyte-api/request_args/httpResponseHeaders': 545,
'scrapy-zyte-api/request_args/sessionContext': 545,
'scrapy-zyte-api/request_args/url': 545,
'scrapy-zyte-api/status_codes/200': 545,
'scrapy-zyte-api/success': 545,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 1, 27, 21, 0, 12, 125472, tzinfo=datetime.timezone.utc)}
2026-01-27 21:03:12 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-27 21:03:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5e1b5ac910>
2026-01-27 21:03:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5e1b5ad090>