2025-12-05 21:00:11 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 21:00:11 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 21:00:11 [auto1.it] INFO: Starting spider auto1.it
2025-12-05 21:00:11 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 21:00:11 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 21:00:11 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 21:00:11 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 21:00:11 [scrapy.extensions.telnet] INFO: Telnet Password: e154951f8de9935a
2025-12-05 21:00:11 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2025-12-05 21:00:11 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_74_2025-12-05T21_00_01.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2025-12-05 21:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 21:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 21:00:11 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 21:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 21:00:11 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 21:00:11 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 21:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 21:00:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 21:00:12 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 21:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 21:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:12 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 21:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 21:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 21:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 21:00:12 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 21:00:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 21:00:12 [scrapy.core.engine] INFO: Spider opened
2025-12-05 21:00:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 21:00:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2025-12-05 21:00:12 [scrapy-playwright] INFO: Starting download handler
2025-12-05 21:00:12 [scrapy-playwright] INFO: Starting download handler
2025-12-05 21:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2025-12-05 21:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2025-12-05 21:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2025-12-05 21:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2025-12-05 21:00:23 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: EH50837
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH50837%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for EH50837: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: VE11407
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE11407%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for VE11407: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: XM76789
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM76789%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for XM76789: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: DE99419
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE99419%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for DE99419: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: LW50261
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW50261%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for LW50261: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: YD46030
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46030%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for YD46030: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: EK97889
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK97889%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for EK97889: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: YD04082
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD04082%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for YD04082: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: AB13595
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB13595%27 HTTP/1.1" 200 None
2025-12-05 21:00:23 [auto1.it] INFO: Scrape type for AB13595: 0
2025-12-05 21:00:23 [auto1.it] INFO: Found listing with ID: UU64111
2025-12-05 21:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64111%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for UU64111: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: DX87902
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX87902%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for DX87902: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: YM94819
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM94819%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for YM94819: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: SX24290
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX24290%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for SX24290: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: TH75264
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH75264%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for TH75264: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: JR02113
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02113%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for JR02113: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: KR41541
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR41541%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for KR41541: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: US78737
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US78737%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for US78737: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: RX45819
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX45819%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for RX45819: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: BD13834
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD13834%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for BD13834: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: WF89394
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF89394%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for WF89394: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: HP29933
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP29933%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for HP29933: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: EH65548
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH65548%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for EH65548: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: VU11747
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11747%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for VU11747: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: GU76780
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU76780%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for GU76780: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: ED77017
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77017%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for ED77017: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: WD58389
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD58389%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for WD58389: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: WW19870
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19870%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for WW19870: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: PW60700
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW60700%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for PW60700: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: UK96914
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK96914%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for UK96914: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: JB89811
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB89811%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for JB89811: 2
2025-12-05 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: CM21448
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM21448%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for CM21448: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: DL80680
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL80680%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for DL80680: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: LX26902
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX26902%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for LX26902: 2
2025-12-05 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: NZ68361
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ68361%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for NZ68361: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: JX61108
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX61108%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for JX61108: 2
2025-12-05 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: HW64559
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for HW64559: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: HV38513
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV38513%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for HV38513: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: KW26134
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW26134%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for KW26134: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: TZ24707
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for TZ24707: 0
2025-12-05 21:00:24 [auto1.it] INFO: Found listing with ID: XD59619
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD59619%27 HTTP/1.1" 200 None
2025-12-05 21:00:24 [auto1.it] INFO: Scrape type for XD59619: 0
2025-12-05 21:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX26902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX61108/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:25 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: EH50837
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH50837%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for EH50837: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: VE11407
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE11407%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for VE11407: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: XM76789
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM76789%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for XM76789: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: DE99419
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE99419%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for DE99419: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: LW50261
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW50261%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for LW50261: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: YD46030
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46030%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for YD46030: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: EK97889
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK97889%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for EK97889: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: YD04082
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD04082%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for YD04082: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: AB13595
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB13595%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for AB13595: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: UU64111
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64111%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for UU64111: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: DX87902
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX87902%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for DX87902: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: YM94819
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM94819%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for YM94819: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: SX24290
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX24290%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for SX24290: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: TH75264
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH75264%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for TH75264: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: JR02113
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02113%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for JR02113: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: KR41541
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR41541%27 HTTP/1.1" 200 None
2025-12-05 21:00:25 [auto1.it] INFO: Scrape type for KR41541: 0
2025-12-05 21:00:25 [auto1.it] INFO: Found listing with ID: US78737
2025-12-05 21:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US78737%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for US78737: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: RX45819
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX45819%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for RX45819: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: BD13834
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD13834%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for BD13834: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: WF89394
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF89394%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for WF89394: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: HP29933
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP29933%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for HP29933: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: EH65548
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH65548%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for EH65548: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: VU11747
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11747%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for VU11747: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: GU76780
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU76780%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for GU76780: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: ED77017
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77017%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for ED77017: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: WD58389
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD58389%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for WD58389: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: WW19870
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19870%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for WW19870: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: PW60700
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW60700%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for PW60700: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: UK96914
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK96914%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for UK96914: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: JB89811
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB89811%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for JB89811: 2
2025-12-05 21:00:26 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/JB89811/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2025-12-05 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: CM21448
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM21448%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for CM21448: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: DL80680
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL80680%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for DL80680: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: LX26902
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX26902%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for LX26902: 2
2025-12-05 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB89811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: NZ68361
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ68361%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for NZ68361: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: JX61108
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX61108%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for JX61108: 2
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: HW64559
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for HW64559: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: HV38513
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV38513%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for HV38513: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: KW26134
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW26134%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for KW26134: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: TZ24707
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for TZ24707: 0
2025-12-05 21:00:26 [auto1.it] INFO: Found listing with ID: XD59619
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD59619%27 HTTP/1.1" 200 None
2025-12-05 21:00:26 [auto1.it] INFO: Scrape type for XD59619: 0
2025-12-05 21:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX26902> (referer: https://www.auto1.com/v1/car-details-view/LX26902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ba5069-2a2e-524c-b1de-b4e719c36e92 with identifier: LX26902
2025-12-05 21:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ba5069-2a2e-524c-b1de-b4e719c36e92 with scrape type 2
2025-12-05 21:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ba5069-2a2e-524c-b1de-b4e719c36e92 with scrape type 2
2025-12-05 21:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25ba5069-2a2e-524c-b1de-b4e719c36e92, identifier: LX26902
2025-12-05 21:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25ba5069-2a2e-524c-b1de-b4e719c36e92 with identifier: LX26902
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2025-12-05 21:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2025-12-05 21:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25ba5069-2a2e-524c-b1de-b4e719c36e92 with identifier: LX26902
2025-12-05 21:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159313 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159313
2025-12-05 21:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 25ba5069-2a2e-524c-b1de-b4e719c36e92 spider: auto1.it
2025-12-05 21:00:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 25ba5069-2a2e-524c-b1de-b4e719c36e92 due to rule: high_mileage_for_country.json, error: 159313 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159313
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 235,
'expiration_date': '2025-12-06T16:00:01Z',
'fuel_type': 'diesel',
'id': '25ba5069-2a2e-524c-b1de-b4e719c36e92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX26902',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Volvo',
'model': 'XC90',
'odometer': 159313,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-11',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2019}
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX26902%27 HTTP/1.1" 200 None
2025-12-05 21:00:27 [auto1.it] INFO: Saving data for LX26902: {'auction_closing_time': 1765036801.0, 'created_time': 1762891597.291689, 'last_price_update_time': 1764968427.389156}
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX26902') HTTP/1.1" 204 0
2025-12-05 21:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX61108> (referer: https://www.auto1.com/v1/car-details-view/JX61108/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:27 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:00:27 [auto1.it] INFO: Found listing with ID: GG19645
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG19645%27 HTTP/1.1" 200 None
2025-12-05 21:00:27 [auto1.it] INFO: Scrape type for GG19645: 0
2025-12-05 21:00:27 [auto1.it] INFO: Found listing with ID: XX17565
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX17565%27 HTTP/1.1" 200 None
2025-12-05 21:00:27 [auto1.it] INFO: Scrape type for XX17565: 0
2025-12-05 21:00:27 [auto1.it] INFO: Found listing with ID: ZE44848
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE44848%27 HTTP/1.1" 200 None
2025-12-05 21:00:27 [auto1.it] INFO: Scrape type for ZE44848: 2
2025-12-05 21:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26890a05-21f4-56d0-8e20-346405830211 with identifier: JX61108
2025-12-05 21:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26890a05-21f4-56d0-8e20-346405830211 with scrape type 2
2025-12-05 21:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26890a05-21f4-56d0-8e20-346405830211 with scrape type 2
2025-12-05 21:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26890a05-21f4-56d0-8e20-346405830211, identifier: JX61108
2025-12-05 21:00:27 [auto1.it] INFO: Found listing with ID: CU64074
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU64074%27 HTTP/1.1" 200 None
2025-12-05 21:00:27 [auto1.it] INFO: Scrape type for CU64074: 0
2025-12-05 21:00:27 [auto1.it] INFO: Found listing with ID: GE32816
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE32816%27 HTTP/1.1" 200 None
2025-12-05 21:00:27 [auto1.it] INFO: Scrape type for GE32816: 2
2025-12-05 21:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26890a05-21f4-56d0-8e20-346405830211 with identifier: JX61108
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2025-12-05 21:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2025-12-05 21:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26890a05-21f4-56d0-8e20-346405830211 with identifier: JX61108
2025-12-05 21:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130153 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130153
2025-12-05 21:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 26890a05-21f4-56d0-8e20-346405830211 spider: auto1.it
2025-12-05 21:00:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 26890a05-21f4-56d0-8e20-346405830211 due to rule: high_mileage_for_make.json, error: 130153 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130153
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:31:49Z',
'fuel_type': 'petrol',
'id': '26890a05-21f4-56d0-8e20-346405830211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX61108',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Peugeot',
'model': '2008',
'odometer': 130153,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX61108%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Saving data for JX61108: {'auction_closing_time': 1765038709.0, 'created_time': 1764878807.81863, 'last_price_update_time': 1764968428.256904}
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX61108') HTTP/1.1" 204 0
2025-12-05 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: SJ43277
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ43277%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for SJ43277: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: XR03874
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR03874%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for XR03874: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: SB13925
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB13925%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for SB13925: 2
2025-12-05 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: ZK51756
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK51756%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for ZK51756: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: GF33342
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF33342%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for GF33342: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: YB62533
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB62533%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for YB62533: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: UD94632
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD94632%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for UD94632: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: MR53834
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR53834%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for MR53834: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: UX72610
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX72610%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for UX72610: 2
2025-12-05 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: RM85367
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM85367%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for RM85367: 2
2025-12-05 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: MU15343
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU15343%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for MU15343: 2
2025-12-05 21:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB89811> (referer: https://www.auto1.com/v1/car-details-view/JB89811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: AR46533
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR46533%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for AR46533: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: KH83938
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH83938%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for KH83938: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: CR95070
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR95070%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for CR95070: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: XY45470
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY45470%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for XY45470: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: LP81451
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP81451%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for LP81451: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: FP59077
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP59077%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for FP59077: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: HW41289
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW41289%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for HW41289: 0
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: HY82993
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82993%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for HY82993: 2
2025-12-05 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: WD98953
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for WD98953: 2
2025-12-05 21:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1256e1-528d-5bce-bd7e-07fdfbd81f78 with identifier: JB89811
2025-12-05 21:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1256e1-528d-5bce-bd7e-07fdfbd81f78 with scrape type 2
2025-12-05 21:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1256e1-528d-5bce-bd7e-07fdfbd81f78 with scrape type 2
2025-12-05 21:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f1256e1-528d-5bce-bd7e-07fdfbd81f78, identifier: JB89811
2025-12-05 21:00:28 [auto1.it] INFO: Found listing with ID: MD81052
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD81052%27 HTTP/1.1" 200 None
2025-12-05 21:00:28 [auto1.it] INFO: Scrape type for MD81052: 2
2025-12-05 21:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f1256e1-528d-5bce-bd7e-07fdfbd81f78 with identifier: JB89811
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2025-12-05 21:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f1256e1-528d-5bce-bd7e-07fdfbd81f78 with identifier: JB89811
2025-12-05 21:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f1256e1-528d-5bce-bd7e-07fdfbd81f78 with identifier: JB89811 to the API
2025-12-05 21:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB89811>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:33:47Z',
'fuel_type': 'petrol',
'id': '7f1256e1-528d-5bce-bd7e-07fdfbd81f78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB89811',
'listing': 'auction',
'location': 'IT',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 122448,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2018}
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB89811%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Saving data for JB89811: {'auction_closing_time': 1765038827.0, 'created_time': 1764878741.895437, 'last_price_update_time': 1764968429.16844}
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB89811') HTTP/1.1" 204 0
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: AT29817
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT29817%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for AT29817: 0
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: SS33960
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS33960%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for SS33960: 2
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: XV25208
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25208%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for XV25208: 0
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: PN13750
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN13750%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for PN13750: 0
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: WA30602
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA30602%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for WA30602: 2
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: TJ68203
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ68203%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for TJ68203: 2
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: PT73799
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT73799%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for PT73799: 0
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: KM02872
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM02872%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for KM02872: 2
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: RX31393
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for RX31393: 2
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: CK36923
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK36923%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for CK36923: 0
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: BY02690
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY02690%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for BY02690: 2
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: HK71653
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK71653%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for HK71653: 2
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: WZ62435
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ62435%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for WZ62435: 2
2025-12-05 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE32816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:29 [auto1.it] INFO: Found listing with ID: ZN73329
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN73329%27 HTTP/1.1" 200 None
2025-12-05 21:00:29 [auto1.it] INFO: Scrape type for ZN73329: 0
2025-12-05 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE44848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB13925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU15343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM85367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX72610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY82993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD98953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: YC62647
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC62647%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for YC62647: 0
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: BC61751
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC61751%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for BC61751: 0
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: BS05817
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS05817%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for BS05817: 2
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: WS74812
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS74812%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for WS74812: 0
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: EX29579
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX29579%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for EX29579: 0
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: HE46295
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for HE46295: 2
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: YU19851
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU19851%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for YU19851: 2
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: VU47958
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU47958%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for VU47958: 2
2025-12-05 21:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD81052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: XC50328
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50328%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for XC50328: 2
2025-12-05 21:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: WV64596
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV64596%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for WV64596: 0
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: FF86857
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF86857%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for FF86857: 0
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: MR91682
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR91682%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for MR91682: 0
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: NY40459
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY40459%27 HTTP/1.1" 200 None
2025-12-05 21:00:30 [auto1.it] INFO: Scrape type for NY40459: 2
2025-12-05 21:00:30 [auto1.it] INFO: Found listing with ID: GU84869
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU84869%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for GU84869: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: UV50835
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV50835%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for UV50835: 2
2025-12-05 21:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS33960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM02872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ68203/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA30602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: UJ32483
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ32483%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for UJ32483: 2
2025-12-05 21:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: GY37830
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY37830%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for GY37830: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: AF72034
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF72034%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for AF72034: 2
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: FN18507
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN18507%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for FN18507: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: HL50165
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL50165%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for HL50165: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: DC75270
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC75270%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for DC75270: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: MP22831
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP22831%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for MP22831: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: FM62222
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM62222%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for FM62222: 2
2025-12-05 21:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX31393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: JM46958
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM46958%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for JM46958: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: LU84839
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU84839%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for LU84839: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: BT69215
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT69215%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for BT69215: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: UL05491
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL05491%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for UL05491: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: TW13967
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW13967%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for TW13967: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: FP51001
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP51001%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for FP51001: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: WU55594
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU55594%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for WU55594: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: CV66945
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV66945%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for CV66945: 2
2025-12-05 21:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: LP33794
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP33794%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for LP33794: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: MV61380
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV61380%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for MV61380: 2
2025-12-05 21:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY02690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: FJ07347
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ07347%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for FJ07347: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: MX11198
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for MX11198: 2
2025-12-05 21:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: EW36675
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for EW36675: 2
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: AJ19818
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ19818%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for AJ19818: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: KZ32796
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ32796%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for KZ32796: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: BY71307
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY71307%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for BY71307: 0
2025-12-05 21:00:31 [auto1.it] INFO: Found listing with ID: RT08597
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT08597%27 HTTP/1.1" 200 None
2025-12-05 21:00:31 [auto1.it] INFO: Scrape type for RT08597: 0
2025-12-05 21:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ62435/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK71653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE32816> (referer: https://www.auto1.com/v1/car-details-view/GE32816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE44848> (referer: https://www.auto1.com/v1/car-details-view/ZE44848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU15343> (referer: https://www.auto1.com/v1/car-details-view/MU15343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f50dbb-36e2-589d-95ee-40de02e3bbb0 with identifier: GE32816
2025-12-05 21:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f50dbb-36e2-589d-95ee-40de02e3bbb0 with scrape type 2
2025-12-05 21:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f50dbb-36e2-589d-95ee-40de02e3bbb0 with scrape type 2
2025-12-05 21:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9f50dbb-36e2-589d-95ee-40de02e3bbb0, identifier: GE32816
2025-12-05 21:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9f50dbb-36e2-589d-95ee-40de02e3bbb0 with identifier: GE32816
2025-12-05 21:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2025-12-05 21:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9f50dbb-36e2-589d-95ee-40de02e3bbb0 with identifier: GE32816
2025-12-05 21:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b9f50dbb-36e2-589d-95ee-40de02e3bbb0 with identifier: GE32816 to the API
2025-12-05 21:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GE32816>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2025-12-06T16:00:40Z',
'fuel_type': 'diesel',
'id': 'b9f50dbb-36e2-589d-95ee-40de02e3bbb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE32816',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'BMW',
'model': 'X5',
'odometer': 121778,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-11',
'seats_number': 4,
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE32816%27 HTTP/1.1" 200 None
2025-12-05 21:00:33 [auto1.it] INFO: Saving data for GE32816: {'auction_closing_time': 1765036840.0, 'created_time': 1764878588.791208, 'last_price_update_time': 1764968433.16149}
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE32816') HTTP/1.1" 204 0
2025-12-05 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM85367> (referer: https://www.auto1.com/v1/car-details-view/RM85367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB13925> (referer: https://www.auto1.com/v1/car-details-view/SB13925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX72610> (referer: https://www.auto1.com/v1/car-details-view/UX72610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY82993> (referer: https://www.auto1.com/v1/car-details-view/HY82993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU47958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1926fd7-e287-53fe-98c5-cfa6b53ef1a6 with identifier: ZE44848
2025-12-05 21:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1926fd7-e287-53fe-98c5-cfa6b53ef1a6 with scrape type 2
2025-12-05 21:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1926fd7-e287-53fe-98c5-cfa6b53ef1a6 with scrape type 2
2025-12-05 21:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1926fd7-e287-53fe-98c5-cfa6b53ef1a6, identifier: ZE44848
2025-12-05 21:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 611cf2fc-76f8-58ee-af35-9800d05b93ba with identifier: MU15343
2025-12-05 21:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 611cf2fc-76f8-58ee-af35-9800d05b93ba with scrape type 2
2025-12-05 21:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 611cf2fc-76f8-58ee-af35-9800d05b93ba with scrape type 2
2025-12-05 21:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 611cf2fc-76f8-58ee-af35-9800d05b93ba, identifier: MU15343
2025-12-05 21:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1926fd7-e287-53fe-98c5-cfa6b53ef1a6 with identifier: ZE44848
2025-12-05 21:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1926fd7-e287-53fe-98c5-cfa6b53ef1a6 with identifier: ZE44848
2025-12-05 21:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c1926fd7-e287-53fe-98c5-cfa6b53ef1a6 with identifier: ZE44848 to the API
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE44848>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:48:51Z',
'fuel_type': 'diesel',
'id': 'c1926fd7-e287-53fe-98c5-cfa6b53ef1a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE44848',
'listing': 'auction',
'location': 'IT, Gioia Tauro (RC)',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 72127,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2022}
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE44848%27 HTTP/1.1" 200 None
2025-12-05 21:00:33 [auto1.it] INFO: Saving data for ZE44848: {'auction_closing_time': 1765039731.0, 'created_time': 1764878565.911218, 'last_price_update_time': 1764968433.80618}
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZE44848') HTTP/1.1" 204 0
2025-12-05 21:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 611cf2fc-76f8-58ee-af35-9800d05b93ba with identifier: MU15343
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2025-12-05 21:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 611cf2fc-76f8-58ee-af35-9800d05b93ba with identifier: MU15343
2025-12-05 21:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172405 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172405
2025-12-05 21:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 611cf2fc-76f8-58ee-af35-9800d05b93ba spider: auto1.it
2025-12-05 21:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 611cf2fc-76f8-58ee-af35-9800d05b93ba due to rule: high_mileage_for_country.json, error: 172405 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172405
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:44:32Z',
'fuel_type': 'diesel',
'id': '611cf2fc-76f8-58ee-af35-9800d05b93ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU15343',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 172405,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Executive BlueMotion',
'transmission': 'manual',
'trim': 'Executive BlueMotion',
'year': 2019}
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU15343%27 HTTP/1.1" 200 None
2025-12-05 21:00:34 [auto1.it] INFO: Saving data for MU15343: {'auction_closing_time': 1765039472.0, 'created_time': 1764878701.435673, 'last_price_update_time': 1764968434.188985}
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU15343') HTTP/1.1" 204 0
2025-12-05 21:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 398df7e5-1cad-5861-be1e-a9f812d02921 with identifier: RM85367
2025-12-05 21:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 398df7e5-1cad-5861-be1e-a9f812d02921 with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 398df7e5-1cad-5861-be1e-a9f812d02921 with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 398df7e5-1cad-5861-be1e-a9f812d02921, identifier: RM85367
2025-12-05 21:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925
2025-12-05 21:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07e6e290-030a-52db-ae13-9d05a5ed649e with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07e6e290-030a-52db-ae13-9d05a5ed649e with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07e6e290-030a-52db-ae13-9d05a5ed649e, identifier: SB13925
2025-12-05 21:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8723bba8-e5e9-52df-8234-4bbe5a1221ec with identifier: UX72610
2025-12-05 21:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8723bba8-e5e9-52df-8234-4bbe5a1221ec with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8723bba8-e5e9-52df-8234-4bbe5a1221ec with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8723bba8-e5e9-52df-8234-4bbe5a1221ec, identifier: UX72610
2025-12-05 21:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b561df59-0bb6-5509-9c09-2e60876d7458 with identifier: HY82993
2025-12-05 21:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b561df59-0bb6-5509-9c09-2e60876d7458 with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b561df59-0bb6-5509-9c09-2e60876d7458 with scrape type 2
2025-12-05 21:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b561df59-0bb6-5509-9c09-2e60876d7458, identifier: HY82993
2025-12-05 21:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 398df7e5-1cad-5861-be1e-a9f812d02921 with identifier: RM85367
2025-12-05 21:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 398df7e5-1cad-5861-be1e-a9f812d02921 with identifier: RM85367
2025-12-05 21:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 398df7e5-1cad-5861-be1e-a9f812d02921 with identifier: RM85367 to the API
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM85367>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2025-12-06T16:22:57Z',
'fuel_type': 'diesel',
'id': '398df7e5-1cad-5861-be1e-a9f812d02921',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM85367',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 74920,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2018}
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM85367%27 HTTP/1.1" 200 None
2025-12-05 21:00:34 [auto1.it] INFO: Saving data for RM85367: {'auction_closing_time': 1765038177.0, 'created_time': 1764878553.795587, 'last_price_update_time': 1764968434.968704}
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RM85367') HTTP/1.1" 204 0
2025-12-05 21:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925
2025-12-05 21:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925
2025-12-05 21:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925 to the API
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB13925>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:23:33Z',
'fuel_type': 'diesel',
'id': '07e6e290-030a-52db-ae13-9d05a5ed649e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB13925',
'listing': 'auction',
'location': 'IT, Palermo',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 51569,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2018}
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB13925%27 HTTP/1.1" 200 None
2025-12-05 21:00:35 [auto1.it] INFO: Saving data for SB13925: {'auction_closing_time': 1765038213.0, 'created_time': 1764878631.870619, 'last_price_update_time': 1764968435.276191}
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB13925') HTTP/1.1" 204 0
2025-12-05 21:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8723bba8-e5e9-52df-8234-4bbe5a1221ec with identifier: UX72610
2025-12-05 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8723bba8-e5e9-52df-8234-4bbe5a1221ec with identifier: UX72610
2025-12-05 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2025-12-05 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8723bba8-e5e9-52df-8234-4bbe5a1221ec spider: auto1.it
2025-12-05 21:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8723bba8-e5e9-52df-8234-4bbe5a1221ec due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:30:30Z',
'fuel_type': 'petrol',
'id': '8723bba8-e5e9-52df-8234-4bbe5a1221ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX72610',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Fiat',
'model': 'Panda',
'odometer': 68251,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-23',
'seats_number': 2,
'seller_name': None,
'title': 'Fiat Panda 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2019}
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX72610%27 HTTP/1.1" 200 None
2025-12-05 21:00:35 [auto1.it] INFO: Saving data for UX72610: {'auction_closing_time': 1765038630.0, 'created_time': 1764878578.435643, 'last_price_update_time': 1764968435.489324}
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UX72610') HTTP/1.1" 204 0
2025-12-05 21:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b561df59-0bb6-5509-9c09-2e60876d7458 with identifier: HY82993
2025-12-05 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b561df59-0bb6-5509-9c09-2e60876d7458 with identifier: HY82993
2025-12-05 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159158 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159158
2025-12-05 21:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b561df59-0bb6-5509-9c09-2e60876d7458 spider: auto1.it
2025-12-05 21:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: b561df59-0bb6-5509-9c09-2e60876d7458 due to rule: high_mileage_for_country.json, error: 159158 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159158
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:34:37Z',
'fuel_type': 'diesel',
'id': 'b561df59-0bb6-5509-9c09-2e60876d7458',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY82993',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 159158,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 Cross Country 2.0 D3 Summum',
'transmission': 'automatic',
'trim': 'Summum',
'year': 2017}
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82993%27 HTTP/1.1" 200 None
2025-12-05 21:00:35 [auto1.it] INFO: Saving data for HY82993: {'auction_closing_time': 1765038877.0, 'created_time': 1764878857.559376, 'last_price_update_time': 1764968435.717192}
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY82993') HTTP/1.1" 204 0
2025-12-05 21:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV50835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD81052> (referer: https://www.auto1.com/v1/car-details-view/MD81052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY40459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d3501f-a924-5a90-ba72-6010b0231947 with identifier: MD81052
2025-12-05 21:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d3501f-a924-5a90-ba72-6010b0231947 with scrape type 2
2025-12-05 21:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37d3501f-a924-5a90-ba72-6010b0231947 with scrape type 2
2025-12-05 21:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 37d3501f-a924-5a90-ba72-6010b0231947, identifier: MD81052
2025-12-05 21:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 37d3501f-a924-5a90-ba72-6010b0231947 with identifier: MD81052
2025-12-05 21:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2025-12-05 21:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 37d3501f-a924-5a90-ba72-6010b0231947 with identifier: MD81052
2025-12-05 21:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 37d3501f-a924-5a90-ba72-6010b0231947 with identifier: MD81052 to the API
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD81052>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '3.0L',
'engine_horse_power': 394,
'expiration_date': '2025-12-06T16:31:07Z',
'fuel_type': 'hybrid',
'id': '37d3501f-a924-5a90-ba72-6010b0231947',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD81052',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'BMW',
'model': 'X5',
'odometer': 121658,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 45e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2022}
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD81052%27 HTTP/1.1" 200 None
2025-12-05 21:00:36 [auto1.it] INFO: Saving data for MD81052: {'auction_closing_time': 1765038667.0, 'created_time': 1764878752.01321, 'last_price_update_time': 1764968436.420723}
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD81052') HTTP/1.1" 204 0
2025-12-05 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC50328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM62222/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY02690> (referer: https://www.auto1.com/v1/car-details-view/BY02690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ62435> (referer: https://www.auto1.com/v1/car-details-view/WZ62435/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4458ba63-f255-5eb1-9e01-e716fff6f12b with identifier: BY02690
2025-12-05 21:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4458ba63-f255-5eb1-9e01-e716fff6f12b with scrape type 2
2025-12-05 21:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4458ba63-f255-5eb1-9e01-e716fff6f12b with scrape type 2
2025-12-05 21:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4458ba63-f255-5eb1-9e01-e716fff6f12b, identifier: BY02690
2025-12-05 21:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4458ba63-f255-5eb1-9e01-e716fff6f12b with identifier: BY02690
2025-12-05 21:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4458ba63-f255-5eb1-9e01-e716fff6f12b with identifier: BY02690
2025-12-05 21:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4458ba63-f255-5eb1-9e01-e716fff6f12b with identifier: BY02690 to the API
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY02690>
{'auction_title': '',
'c_o_2_emission_value': 180,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 250,
'expiration_date': '2025-12-06T16:20:06Z',
'fuel_type': 'petrol',
'id': '4458ba63-f255-5eb1-9e01-e716fff6f12b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY02690',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 82847,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque P250 Mild-Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2019}
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY02690%27 HTTP/1.1" 200 None
2025-12-05 21:00:36 [auto1.it] INFO: Saving data for BY02690: {'auction_closing_time': 1765038006.0, 'created_time': 1762545704.534397, 'last_price_update_time': 1764968436.960171}
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY02690') HTTP/1.1" 204 0
2025-12-05 21:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA30602> (referer: https://www.auto1.com/v1/car-details-view/WA30602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 695626ce-b08b-5691-83b7-330042ada661 with identifier: WZ62435
2025-12-05 21:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 695626ce-b08b-5691-83b7-330042ada661 with scrape type 2
2025-12-05 21:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 695626ce-b08b-5691-83b7-330042ada661 with scrape type 2
2025-12-05 21:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 695626ce-b08b-5691-83b7-330042ada661, identifier: WZ62435
2025-12-05 21:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 695626ce-b08b-5691-83b7-330042ada661 with identifier: WZ62435
2025-12-05 21:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 695626ce-b08b-5691-83b7-330042ada661 with identifier: WZ62435
2025-12-05 21:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187187 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187187
2025-12-05 21:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 695626ce-b08b-5691-83b7-330042ada661 spider: auto1.it
2025-12-05 21:00:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 695626ce-b08b-5691-83b7-330042ada661 due to rule: high_mileage_for_country.json, error: 187187 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187187
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:42:27Z',
'fuel_type': 'diesel',
'id': '695626ce-b08b-5691-83b7-330042ada661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ62435',
'listing': 'auction',
'location': 'IT, Treviso',
'make': 'Peugeot',
'model': '5008',
'odometer': 187187,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-20',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2017}
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ62435%27 HTTP/1.1" 200 None
2025-12-05 21:00:37 [auto1.it] INFO: Saving data for WZ62435: {'auction_closing_time': 1765039347.0, 'created_time': 1764792078.773618, 'last_price_update_time': 1764968437.284367}
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WZ62435') HTTP/1.1" 204 0
2025-12-05 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK71653> (referer: https://www.auto1.com/v1/car-details-view/HK71653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602
2025-12-05 21:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 405ba6b0-e495-5350-a910-475daac5fc27 with scrape type 2
2025-12-05 21:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 405ba6b0-e495-5350-a910-475daac5fc27 with scrape type 2
2025-12-05 21:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 405ba6b0-e495-5350-a910-475daac5fc27, identifier: WA30602
2025-12-05 21:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2025-12-05 21:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602
2025-12-05 21:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602 to the API
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA30602>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:58:31Z',
'fuel_type': 'petrol',
'id': '405ba6b0-e495-5350-a910-475daac5fc27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA30602',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Honda',
'model': 'HR-V',
'odometer': 111088,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Honda HR-V 1.5 i-VTEC Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2018}
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA30602%27 HTTP/1.1" 200 None
2025-12-05 21:00:37 [auto1.it] INFO: Saving data for WA30602: {'auction_closing_time': 1765040311.0, 'created_time': 1764878550.095058, 'last_price_update_time': 1764968437.944755}
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA30602') HTTP/1.1" 204 0
2025-12-05 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX31393> (referer: https://www.auto1.com/v1/car-details-view/RX31393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW36675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ68203> (referer: https://www.auto1.com/v1/car-details-view/TJ68203/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX11198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7 with identifier: HK71653
2025-12-05 21:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7 with scrape type 2
2025-12-05 21:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7 with scrape type 2
2025-12-05 21:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7, identifier: HK71653
2025-12-05 21:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7 with identifier: HK71653
2025-12-05 21:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7 with identifier: HK71653
2025-12-05 21:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7 with identifier: HK71653 to the API
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK71653>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:39:11Z',
'fuel_type': 'diesel',
'id': 'ad2196b6-9e7d-5bcf-8fef-12f40fa4e1d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK71653',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'BMW',
'model': '2er',
'odometer': 76816,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2er 220d Active Tourer xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2019}
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK71653%27 HTTP/1.1" 200 None
2025-12-05 21:00:38 [auto1.it] INFO: Saving data for HK71653: {'auction_closing_time': 1765039151.0, 'created_time': 1764878794.465449, 'last_price_update_time': 1764968438.35047}
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK71653') HTTP/1.1" 204 0
2025-12-05 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS33960> (referer: https://www.auto1.com/v1/car-details-view/SS33960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM02872> (referer: https://www.auto1.com/v1/car-details-view/KM02872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393
2025-12-05 21:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with scrape type 2
2025-12-05 21:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with scrape type 2
2025-12-05 21:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7, identifier: RX31393
2025-12-05 21:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98a39826-5503-5a4e-a49e-04afa8061fbe with identifier: TJ68203
2025-12-05 21:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98a39826-5503-5a4e-a49e-04afa8061fbe with scrape type 2
2025-12-05 21:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98a39826-5503-5a4e-a49e-04afa8061fbe with scrape type 2
2025-12-05 21:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98a39826-5503-5a4e-a49e-04afa8061fbe, identifier: TJ68203
2025-12-05 21:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393
2025-12-05 21:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393
2025-12-05 21:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393 to the API
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX31393>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:03:54Z',
'fuel_type': 'diesel',
'id': 'bcac54e6-4a4a-5b26-b2ee-2a3c007937d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX31393',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 50270,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-26',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2023}
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2025-12-05 21:00:38 [auto1.it] INFO: Saving data for RX31393: {'auction_closing_time': 1765037034.0, 'created_time': 1764878548.043204, 'last_price_update_time': 1764968438.876403}
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX31393') HTTP/1.1" 204 0
2025-12-05 21:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98a39826-5503-5a4e-a49e-04afa8061fbe with identifier: TJ68203
2025-12-05 21:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98a39826-5503-5a4e-a49e-04afa8061fbe with identifier: TJ68203
2025-12-05 21:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98a39826-5503-5a4e-a49e-04afa8061fbe with identifier: TJ68203 to the API
2025-12-05 21:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TJ68203>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2025-12-06T16:33:45Z',
'fuel_type': 'petrol',
'id': '98a39826-5503-5a4e-a49e-04afa8061fbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ68203',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Suzuki',
'model': 'Celerio',
'odometer': 75025,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Celerio 1.0 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2018}
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ68203%27 HTTP/1.1" 200 None
2025-12-05 21:00:39 [auto1.it] INFO: Saving data for TJ68203: {'auction_closing_time': 1765038825.0, 'created_time': 1764878814.03673, 'last_price_update_time': 1764968439.194515}
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ68203') HTTP/1.1" 204 0
2025-12-05 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV61380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0885b810-529d-534a-aa64-d92ce7528c09 with identifier: SS33960
2025-12-05 21:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0885b810-529d-534a-aa64-d92ce7528c09 with scrape type 2
2025-12-05 21:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0885b810-529d-534a-aa64-d92ce7528c09 with scrape type 2
2025-12-05 21:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0885b810-529d-534a-aa64-d92ce7528c09, identifier: SS33960
2025-12-05 21:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872
2025-12-05 21:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099e54e2-eb4c-566e-adce-49c80fcf33fb with scrape type 2
2025-12-05 21:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 099e54e2-eb4c-566e-adce-49c80fcf33fb with scrape type 2
2025-12-05 21:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 099e54e2-eb4c-566e-adce-49c80fcf33fb, identifier: KM02872
2025-12-05 21:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0885b810-529d-534a-aa64-d92ce7528c09 with identifier: SS33960
2025-12-05 21:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0885b810-529d-534a-aa64-d92ce7528c09 with identifier: SS33960
2025-12-05 21:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mitsubishi' containing 'mitsubishi' and model 'l 200' containing 'l 200'
2025-12-05 21:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0885b810-529d-534a-aa64-d92ce7528c09 spider: auto1.it
2025-12-05 21:00:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0885b810-529d-534a-aa64-d92ce7528c09 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mitsubishi' containing 'mitsubishi' and model 'l 200' containing 'l 200'
{'auction_title': '',
'c_o_2_emission_value': 180,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.4L',
'engine_horse_power': 155,
'expiration_date': '2025-12-06T16:55:59Z',
'fuel_type': 'diesel',
'id': '0885b810-529d-534a-aa64-d92ce7528c09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS33960',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Mitsubishi',
'model': 'L 200',
'odometer': 75281,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi L 200 2.4 DI-D Basis Doppelkabine 4WD',
'transmission': 'manual',
'trim': 'Basis Doppelkabine 4WD',
'year': 2019}
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS33960%27 HTTP/1.1" 200 None
2025-12-05 21:00:39 [auto1.it] INFO: Saving data for SS33960: {'auction_closing_time': 1765040159.0, 'created_time': 1764878623.621571, 'last_price_update_time': 1764968439.60684}
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS33960') HTTP/1.1" 204 0
2025-12-05 21:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872
2025-12-05 21:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872
2025-12-05 21:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872 to the API
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KM02872>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:00:24Z',
'fuel_type': 'diesel',
'id': '099e54e2-eb4c-566e-adce-49c80fcf33fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM02872',
'listing': 'auction',
'location': 'IT, Frosinone',
'make': 'Audi',
'model': 'Q5',
'odometer': 46321,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM02872%27 HTTP/1.1" 200 None
2025-12-05 21:00:39 [auto1.it] INFO: Saving data for KM02872: {'auction_closing_time': 1765036824.0, 'created_time': 1764878783.015224, 'last_price_update_time': 1764968439.924756}
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM02872') HTTP/1.1" 204 0
2025-12-05 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV66945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF72034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU47958> (referer: https://www.auto1.com/v1/car-details-view/VU47958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY40459> (referer: https://www.auto1.com/v1/car-details-view/NY40459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc with identifier: VU47958
2025-12-05 21:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc with scrape type 2
2025-12-05 21:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc with scrape type 2
2025-12-05 21:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc, identifier: VU47958
2025-12-05 21:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc with identifier: VU47958
2025-12-05 21:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc with identifier: VU47958
2025-12-05 21:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc with identifier: VU47958 to the API
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU47958>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:38:14Z',
'fuel_type': 'diesel',
'id': '41b11b9b-3ac6-5498-bf53-8bb35d3c9bdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU47958',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'BMW',
'model': 'X3',
'odometer': 53238,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU47958%27 HTTP/1.1" 200 None
2025-12-05 21:00:40 [auto1.it] INFO: Saving data for VU47958: {'auction_closing_time': 1765039094.0, 'created_time': 1764878803.065411, 'last_price_update_time': 1764968440.529284}
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU47958') HTTP/1.1" 204 0
2025-12-05 21:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b25c7fd5-d628-50ba-bdc7-458961e83337 with identifier: NY40459
2025-12-05 21:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b25c7fd5-d628-50ba-bdc7-458961e83337 with scrape type 2
2025-12-05 21:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b25c7fd5-d628-50ba-bdc7-458961e83337 with scrape type 2
2025-12-05 21:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b25c7fd5-d628-50ba-bdc7-458961e83337, identifier: NY40459
2025-12-05 21:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b25c7fd5-d628-50ba-bdc7-458961e83337 with identifier: NY40459
2025-12-05 21:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b25c7fd5-d628-50ba-bdc7-458961e83337 with identifier: NY40459
2025-12-05 21:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b25c7fd5-d628-50ba-bdc7-458961e83337 with identifier: NY40459 to the API
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY40459>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:35:49Z',
'fuel_type': 'petrol',
'id': 'b25c7fd5-d628-50ba-bdc7-458961e83337',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY40459',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 22983,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2023}
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY40459%27 HTTP/1.1" 200 None
2025-12-05 21:00:41 [auto1.it] INFO: Saving data for NY40459: {'auction_closing_time': 1765038949.0, 'created_time': 1762768955.055196, 'last_price_update_time': 1764968441.038733}
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY40459') HTTP/1.1" 204 0
2025-12-05 21:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV50835> (referer: https://www.auto1.com/v1/car-details-view/UV50835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU19851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ32483/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19165905-f85a-5ab1-ade1-9766e42879bb with identifier: UV50835
2025-12-05 21:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19165905-f85a-5ab1-ade1-9766e42879bb with scrape type 2
2025-12-05 21:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19165905-f85a-5ab1-ade1-9766e42879bb with scrape type 2
2025-12-05 21:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 19165905-f85a-5ab1-ade1-9766e42879bb, identifier: UV50835
2025-12-05 21:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 19165905-f85a-5ab1-ade1-9766e42879bb with identifier: UV50835
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2025-12-05 21:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 19165905-f85a-5ab1-ade1-9766e42879bb with identifier: UV50835
2025-12-05 21:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 19165905-f85a-5ab1-ade1-9766e42879bb with identifier: UV50835 to the API
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UV50835>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:48:41Z',
'fuel_type': 'diesel',
'id': '19165905-f85a-5ab1-ade1-9766e42879bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV50835',
'listing': 'auction',
'location': 'Casagiove',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 90238,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.5 EcoBlue TDCi ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2019}
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV50835%27 HTTP/1.1" 200 None
2025-12-05 21:00:41 [auto1.it] INFO: Saving data for UV50835: {'auction_closing_time': 1765039721.0, 'created_time': 1764878681.698009, 'last_price_update_time': 1764968441.808174}
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UV50835') HTTP/1.1" 204 0
2025-12-05 21:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE46295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM62222> (referer: https://www.auto1.com/v1/car-details-view/FM62222/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:41 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:00:41 [auto1.it] INFO: Found listing with ID: VL50172
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL50172%27 HTTP/1.1" 200 None
2025-12-05 21:00:41 [auto1.it] INFO: Scrape type for VL50172: 0
2025-12-05 21:00:41 [auto1.it] INFO: Found listing with ID: CG06923
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG06923%27 HTTP/1.1" 200 None
2025-12-05 21:00:41 [auto1.it] INFO: Scrape type for CG06923: 2
2025-12-05 21:00:41 [auto1.it] INFO: Found listing with ID: LJ12272
2025-12-05 21:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ12272%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for LJ12272: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: UA01461
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA01461%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for UA01461: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: BE54104
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54104%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for BE54104: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: VJ46302
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ46302%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for VJ46302: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: TD37557
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD37557%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for TD37557: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: LL77608
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL77608%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for LL77608: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: LC91200
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC91200%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for LC91200: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: BP94413
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP94413%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for BP94413: 2
2025-12-05 21:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fa01653-3dc2-562b-b258-337512b79607 with identifier: FM62222
2025-12-05 21:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fa01653-3dc2-562b-b258-337512b79607 with scrape type 2
2025-12-05 21:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fa01653-3dc2-562b-b258-337512b79607 with scrape type 2
2025-12-05 21:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fa01653-3dc2-562b-b258-337512b79607, identifier: FM62222
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: KR86350
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR86350%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for KR86350: 2
2025-12-05 21:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fa01653-3dc2-562b-b258-337512b79607 with identifier: FM62222
2025-12-05 21:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fa01653-3dc2-562b-b258-337512b79607 with identifier: FM62222
2025-12-05 21:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182376 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
182376
2025-12-05 21:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7fa01653-3dc2-562b-b258-337512b79607 spider: auto1.it
2025-12-05 21:00:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 7fa01653-3dc2-562b-b258-337512b79607 due to rule: high_mileage_for_country.json, error: 182376 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
182376
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:30:06Z',
'fuel_type': 'diesel',
'id': '7fa01653-3dc2-562b-b258-337512b79607',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM62222',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Renault',
'model': 'Clio',
'odometer': 182376,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-28',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2018}
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM62222%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Saving data for FM62222: {'auction_closing_time': 1765038606.0, 'created_time': 1764878577.161557, 'last_price_update_time': 1764968442.455233}
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FM62222') HTTP/1.1" 204 0
2025-12-05 21:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC50328> (referer: https://www.auto1.com/v1/car-details-view/XC50328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: KP05731
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP05731%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for KP05731: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: VK82687
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK82687%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for VK82687: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: MD91819
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD91819%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for MD91819: 2
2025-12-05 21:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS05817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: VH90153
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH90153%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for VH90153: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: VN73607
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN73607%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for VN73607: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: SA69794
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA69794%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for SA69794: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: WW19272
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19272%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for WW19272: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: GM86600
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86600%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for GM86600: 2
2025-12-05 21:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: NX67246
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX67246%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for NX67246: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: RX96026
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX96026%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for RX96026: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: NF87489
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87489%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for NF87489: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: ED89256
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED89256%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for ED89256: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: UB43955
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB43955%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for UB43955: 2
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: GZ35753
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ35753%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for GZ35753: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: WU37931
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU37931%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for WU37931: 0
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: XS04727
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS04727%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for XS04727: 2
2025-12-05 21:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX11198> (referer: https://www.auto1.com/v1/car-details-view/MX11198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD98953> (referer: https://www.auto1.com/v1/car-details-view/WD98953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328
2025-12-05 21:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec42b96-a07b-51b5-9cc9-40e0431f810c with scrape type 2
2025-12-05 21:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec42b96-a07b-51b5-9cc9-40e0431f810c with scrape type 2
2025-12-05 21:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ec42b96-a07b-51b5-9cc9-40e0431f810c, identifier: XC50328
2025-12-05 21:00:42 [auto1.it] INFO: Found listing with ID: RY32891
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY32891%27 HTTP/1.1" 200 None
2025-12-05 21:00:42 [auto1.it] INFO: Scrape type for RY32891: 2
2025-12-05 21:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328
2025-12-05 21:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328
2025-12-05 21:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ec42b96-a07b-51b5-9cc9-40e0431f810c with identifier: XC50328 to the API
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC50328>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:31:50Z',
'fuel_type': 'diesel',
'id': '6ec42b96-a07b-51b5-9cc9-40e0431f810c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC50328',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'BMW',
'model': '1er',
'odometer': 116005,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2020}
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50328%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Saving data for XC50328: {'auction_closing_time': 1765038710.0, 'created_time': 1764878825.835587, 'last_price_update_time': 1764968443.284914}
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC50328') HTTP/1.1" 204 0
2025-12-05 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW36675> (referer: https://www.auto1.com/v1/car-details-view/EW36675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: JE07333
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE07333%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for JE07333: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: UA54226
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54226%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for UA54226: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: LG42514
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG42514%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for LG42514: 2
2025-12-05 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV66945> (referer: https://www.auto1.com/v1/car-details-view/CV66945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF72034> (referer: https://www.auto1.com/v1/car-details-view/AF72034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198
2025-12-05 21:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75018bd5-e8d0-53e5-84da-c0b721745954 with scrape type 2
2025-12-05 21:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75018bd5-e8d0-53e5-84da-c0b721745954 with scrape type 2
2025-12-05 21:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75018bd5-e8d0-53e5-84da-c0b721745954, identifier: MX11198
2025-12-05 21:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953
2025-12-05 21:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07265938-da10-5911-9843-7fae6f5ef686 with scrape type 2
2025-12-05 21:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07265938-da10-5911-9843-7fae6f5ef686 with scrape type 2
2025-12-05 21:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07265938-da10-5911-9843-7fae6f5ef686, identifier: WD98953
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: GJ74171
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ74171%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for GJ74171: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: VJ87382
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ87382%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for VJ87382: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: UA54373
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for UA54373: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: MU47975
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47975%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for MU47975: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: RD01176
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01176%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for RD01176: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: UH13472
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH13472%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for UH13472: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: RT83017
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT83017%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for RT83017: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: LZ55046
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ55046%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for LZ55046: 0
2025-12-05 21:00:43 [auto1.it] INFO: Found listing with ID: NF45221
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF45221%27 HTTP/1.1" 200 None
2025-12-05 21:00:43 [auto1.it] INFO: Scrape type for NF45221: 0
2025-12-05 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2025-12-05 21:00:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198
2025-12-05 21:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198 to the API
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MX11198>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:10:29Z',
'fuel_type': 'petrol',
'id': '75018bd5-e8d0-53e5-84da-c0b721745954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX11198',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Peugeot',
'model': '2008',
'odometer': 35257,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2022}
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2025-12-05 21:00:44 [auto1.it] INFO: Saving data for MX11198: {'auction_closing_time': 1765037429.0, 'created_time': 1762891779.096835, 'last_price_update_time': 1764968444.263355}
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX11198') HTTP/1.1" 204 0
2025-12-05 21:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953
2025-12-05 21:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953
2025-12-05 21:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953 to the API
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WD98953>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 247,
'expiration_date': '2025-12-06T16:01:32Z',
'fuel_type': 'petrol',
'id': '07265938-da10-5911-9843-7fae6f5ef686',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD98953',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volvo',
'model': 'XC40',
'odometer': 19874,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-10',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 2.0 T5 R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2018}
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2025-12-05 21:00:44 [auto1.it] INFO: Saving data for WD98953: {'auction_closing_time': 1765036892.0, 'created_time': 1764878613.334166, 'last_price_update_time': 1764968444.666271}
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD98953') HTTP/1.1" 204 0
2025-12-05 21:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675
2025-12-05 21:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with scrape type 2
2025-12-05 21:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with scrape type 2
2025-12-05 21:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1, identifier: EW36675
2025-12-05 21:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ae79dd8-8756-5650-87de-569234054cb8 with identifier: CV66945
2025-12-05 21:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae79dd8-8756-5650-87de-569234054cb8 with scrape type 2
2025-12-05 21:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ae79dd8-8756-5650-87de-569234054cb8 with scrape type 2
2025-12-05 21:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ae79dd8-8756-5650-87de-569234054cb8, identifier: CV66945
2025-12-05 21:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859cdbb8-2e0e-5abe-a954-7d022bd06e86 with identifier: AF72034
2025-12-05 21:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859cdbb8-2e0e-5abe-a954-7d022bd06e86 with scrape type 2
2025-12-05 21:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859cdbb8-2e0e-5abe-a954-7d022bd06e86 with scrape type 2
2025-12-05 21:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 859cdbb8-2e0e-5abe-a954-7d022bd06e86, identifier: AF72034
2025-12-05 21:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV61380> (referer: https://www.auto1.com/v1/car-details-view/MV61380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675
2025-12-05 21:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675
2025-12-05 21:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675 to the API
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW36675>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:09:00Z',
'fuel_type': 'petrol',
'id': 'a68a6fe0-d772-5ebe-8b4c-2b9a114987f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW36675',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Audi',
'model': 'Q2',
'odometer': 132346,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.0 TFSI Sport ultra',
'transmission': 'automatic',
'trim': 'Sport ultra',
'year': 2018}
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2025-12-05 21:00:45 [auto1.it] INFO: Saving data for EW36675: {'auction_closing_time': 1765037340.0, 'created_time': 1764878551.423085, 'last_price_update_time': 1764968445.285179}
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW36675') HTTP/1.1" 204 0
2025-12-05 21:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ae79dd8-8756-5650-87de-569234054cb8 with identifier: CV66945
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2025-12-05 21:00:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ae79dd8-8756-5650-87de-569234054cb8 with identifier: CV66945
2025-12-05 21:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ae79dd8-8756-5650-87de-569234054cb8 with identifier: CV66945 to the API
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CV66945>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6B',
'engine': '1.4L',
'engine_horse_power': 165,
'expiration_date': '2025-12-06T16:45:29Z',
'fuel_type': 'petrol',
'id': '7ae79dd8-8756-5650-87de-569234054cb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV66945',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Abarth',
'model': '595',
'odometer': 73823,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-22',
'seats_number': 4,
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2018}
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV66945%27 HTTP/1.1" 200 None
2025-12-05 21:00:45 [auto1.it] INFO: Saving data for CV66945: {'auction_closing_time': 1765039529.0, 'created_time': 1764878567.916772, 'last_price_update_time': 1764968445.779093}
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV66945') HTTP/1.1" 204 0
2025-12-05 21:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 859cdbb8-2e0e-5abe-a954-7d022bd06e86 with identifier: AF72034
2025-12-05 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 859cdbb8-2e0e-5abe-a954-7d022bd06e86 with identifier: AF72034
2025-12-05 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175575 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
175575
2025-12-05 21:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 859cdbb8-2e0e-5abe-a954-7d022bd06e86 spider: auto1.it
2025-12-05 21:00:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 859cdbb8-2e0e-5abe-a954-7d022bd06e86 due to rule: high_mileage_for_country.json, error: 175575 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
175575
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2025-12-06T16:16:05Z',
'fuel_type': 'diesel',
'id': '859cdbb8-2e0e-5abe-a954-7d022bd06e86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF72034',
'listing': 'auction',
'location': 'Desio (MB)',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 175575,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
'transmission': 'automatic',
'trim': 'Executive Q4',
'year': 2018}
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF72034%27 HTTP/1.1" 200 None
2025-12-05 21:00:45 [auto1.it] INFO: Saving data for AF72034: {'auction_closing_time': 1765037765.0, 'created_time': 1764878742.128215, 'last_price_update_time': 1764968445.988903}
2025-12-05 21:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF72034') HTTP/1.1" 204 0
2025-12-05 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU19851> (referer: https://www.auto1.com/v1/car-details-view/YU19851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ32483> (referer: https://www.auto1.com/v1/car-details-view/UJ32483/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE46295> (referer: https://www.auto1.com/v1/car-details-view/HE46295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f31ec7bc-8d82-5435-9a6c-9ec849d91536 with identifier: MV61380
2025-12-05 21:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f31ec7bc-8d82-5435-9a6c-9ec849d91536 with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f31ec7bc-8d82-5435-9a6c-9ec849d91536 with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f31ec7bc-8d82-5435-9a6c-9ec849d91536, identifier: MV61380
2025-12-05 21:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f31ec7bc-8d82-5435-9a6c-9ec849d91536 with identifier: MV61380
2025-12-05 21:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f31ec7bc-8d82-5435-9a6c-9ec849d91536 with identifier: MV61380
2025-12-05 21:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f31ec7bc-8d82-5435-9a6c-9ec849d91536 with identifier: MV61380 to the API
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MV61380>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2025-12-06T16:56:50Z',
'fuel_type': 'diesel',
'id': 'f31ec7bc-8d82-5435-9a6c-9ec849d91536',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV61380',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 124343,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Super Q4',
'transmission': 'automatic',
'trim': 'Super Q4',
'year': 2018}
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV61380%27 HTTP/1.1" 200 None
2025-12-05 21:00:46 [auto1.it] INFO: Saving data for MV61380: {'auction_closing_time': 1765040210.0, 'created_time': 1764878568.866004, 'last_price_update_time': 1764968446.386765}
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MV61380') HTTP/1.1" 204 0
2025-12-05 21:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626097a6-eaf9-5ab1-811a-b0eb7721353b with identifier: YU19851
2025-12-05 21:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626097a6-eaf9-5ab1-811a-b0eb7721353b with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626097a6-eaf9-5ab1-811a-b0eb7721353b with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 626097a6-eaf9-5ab1-811a-b0eb7721353b, identifier: YU19851
2025-12-05 21:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e15a7497-82e7-517c-abfc-afa7bd6554ba with identifier: UJ32483
2025-12-05 21:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e15a7497-82e7-517c-abfc-afa7bd6554ba with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e15a7497-82e7-517c-abfc-afa7bd6554ba with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e15a7497-82e7-517c-abfc-afa7bd6554ba, identifier: UJ32483
2025-12-05 21:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295
2025-12-05 21:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e880455b-6b04-52f8-9912-be2ee3772888 with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e880455b-6b04-52f8-9912-be2ee3772888 with scrape type 2
2025-12-05 21:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e880455b-6b04-52f8-9912-be2ee3772888, identifier: HE46295
2025-12-05 21:00:46 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 626097a6-eaf9-5ab1-811a-b0eb7721353b with identifier: YU19851
2025-12-05 21:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 626097a6-eaf9-5ab1-811a-b0eb7721353b with identifier: YU19851
2025-12-05 21:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175657 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
175657
2025-12-05 21:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 626097a6-eaf9-5ab1-811a-b0eb7721353b spider: auto1.it
2025-12-05 21:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 626097a6-eaf9-5ab1-811a-b0eb7721353b due to rule: high_mileage_for_country.json, error: 175657 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
175657
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 241,
'expiration_date': '2025-12-06T16:36:16Z',
'fuel_type': 'diesel',
'id': '626097a6-eaf9-5ab1-811a-b0eb7721353b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU19851',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 175657,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-14',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery Sport D240 R-Dynamic HSE AWD',
'transmission': 'automatic',
'trim': 'R-Dynamic HSE AWD',
'year': 2020}
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU19851%27 HTTP/1.1" 200 None
2025-12-05 21:00:46 [auto1.it] INFO: Saving data for YU19851: {'auction_closing_time': 1765038976.0, 'created_time': 1764878779.906504, 'last_price_update_time': 1764968446.986354}
2025-12-05 21:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU19851') HTTP/1.1" 204 0
2025-12-05 21:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e15a7497-82e7-517c-abfc-afa7bd6554ba with identifier: UJ32483
2025-12-05 21:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e15a7497-82e7-517c-abfc-afa7bd6554ba with identifier: UJ32483
2025-12-05 21:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e15a7497-82e7-517c-abfc-afa7bd6554ba with identifier: UJ32483 to the API
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UJ32483>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:17:05Z',
'fuel_type': 'petrol',
'id': 'e15a7497-82e7-517c-abfc-afa7bd6554ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ32483',
'listing': 'auction',
'location': 'IT, /',
'make': 'Fiat',
'model': '500X',
'odometer': 75256,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.0 Turbo Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2022}
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ32483%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Saving data for UJ32483: {'auction_closing_time': 1765037825.0, 'created_time': 1764878562.916686, 'last_price_update_time': 1764968447.314502}
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UJ32483') HTTP/1.1" 204 0
2025-12-05 21:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295
2025-12-05 21:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295
2025-12-05 21:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295 to the API
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE46295>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:47:41Z',
'fuel_type': 'petrol',
'id': 'e880455b-6b04-52f8-9912-be2ee3772888',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE46295',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Fiat',
'model': '500X',
'odometer': 4534,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.5 Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2024}
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Saving data for HE46295: {'auction_closing_time': 1765039661.0, 'created_time': 1764878506.456874, 'last_price_update_time': 1764968447.608198}
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HE46295') HTTP/1.1" 204 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: HU53329
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53329%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for HU53329: 2
2025-12-05 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR86350/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP94413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: SH46646
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH46646%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for SH46646: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: XK22503
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK22503%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for XK22503: 2
2025-12-05 21:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: PF55031
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF55031%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for PF55031: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: LE73930
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE73930%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for LE73930: 2
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: VK07610
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for VK07610: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: EL05758
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05758%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for EL05758: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: YR95481
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR95481%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for YR95481: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: TF56529
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF56529%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for TF56529: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: ZS31369
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS31369%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for ZS31369: 2
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: TH40683
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH40683%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for TH40683: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: UE72623
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE72623%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for UE72623: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: VV30676
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV30676%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for VV30676: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: SH03361
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH03361%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for SH03361: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: CH47272
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH47272%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for CH47272: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: CZ27491
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ27491%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for CZ27491: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: SN43915
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43915%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for SN43915: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: KW54153
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW54153%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for KW54153: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: YS60698
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for YS60698: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: ZC72396
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC72396%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for ZC72396: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: TW27290
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW27290%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for TW27290: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: RU07739
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU07739%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for RU07739: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: DU87329
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU87329%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for DU87329: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: BT06439
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT06439%27 HTTP/1.1" 200 None
2025-12-05 21:00:47 [auto1.it] INFO: Scrape type for BT06439: 0
2025-12-05 21:00:47 [auto1.it] INFO: Found listing with ID: CC80273
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC80273%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for CC80273: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: YK03588
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK03588%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for YK03588: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: DV77593
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV77593%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for DV77593: 2
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: SU51578
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU51578%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for SU51578: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: NF58021
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF58021%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for NF58021: 2
2025-12-05 21:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG06923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: XB39028
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB39028%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for XB39028: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: PH80137
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH80137%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for PH80137: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: DK20818
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK20818%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for DK20818: 2
2025-12-05 21:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: LJ59063
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ59063%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for LJ59063: 2
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: PD39059
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD39059%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for PD39059: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: NF03892
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF03892%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for NF03892: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: ZE06334
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE06334%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for ZE06334: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: PV10123
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV10123%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for PV10123: 2
2025-12-05 21:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB43955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: MT07045
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT07045%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for MT07045: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: NC36424
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC36424%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for NC36424: 0
2025-12-05 21:00:48 [auto1.it] INFO: Found listing with ID: BN56520
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN56520%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Scrape type for BN56520: 0
2025-12-05 21:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS04727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS05817> (referer: https://www.auto1.com/v1/car-details-view/BS05817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d780097c-1aff-55d5-8dd1-61c6fd642eec with identifier: BS05817
2025-12-05 21:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d780097c-1aff-55d5-8dd1-61c6fd642eec with scrape type 2
2025-12-05 21:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d780097c-1aff-55d5-8dd1-61c6fd642eec with scrape type 2
2025-12-05 21:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d780097c-1aff-55d5-8dd1-61c6fd642eec, identifier: BS05817
2025-12-05 21:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d780097c-1aff-55d5-8dd1-61c6fd642eec with identifier: BS05817
2025-12-05 21:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d780097c-1aff-55d5-8dd1-61c6fd642eec with identifier: BS05817
2025-12-05 21:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d780097c-1aff-55d5-8dd1-61c6fd642eec with identifier: BS05817 to the API
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS05817>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2025-12-06T16:28:03Z',
'fuel_type': 'diesel',
'id': 'd780097c-1aff-55d5-8dd1-61c6fd642eec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS05817',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 126445,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.2 JTDM Veloce',
'transmission': 'automatic',
'trim': 'Veloce',
'year': 2018}
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS05817%27 HTTP/1.1" 200 None
2025-12-05 21:00:48 [auto1.it] INFO: Saving data for BS05817: {'auction_closing_time': 1765038483.0, 'created_time': 1764792056.883217, 'last_price_update_time': 1764968448.937358}
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BS05817') HTTP/1.1" 204 0
2025-12-05 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG42514/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY32891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:49 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: YP57818
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP57818%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for YP57818: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: HY00654
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY00654%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for HY00654: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: KB87323
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB87323%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for KB87323: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: YY50818
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY50818%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for YY50818: 2
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: XM98126
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for XM98126: 2
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: DF71090
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF71090%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for DF71090: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: YJ69591
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ69591%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for YJ69591: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: GE71060
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE71060%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for GE71060: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: WH55073
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55073%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for WH55073: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: FT49386
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT49386%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for FT49386: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: KX58847
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX58847%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for KX58847: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: KH12738
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH12738%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for KH12738: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: PU99942
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU99942%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for PU99942: 2
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: RW28889
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW28889%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for RW28889: 2
2025-12-05 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU53329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: ZW50433
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW50433%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for ZW50433: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: RS56178
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56178%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for RS56178: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: BB58420
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB58420%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for BB58420: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: RD01541
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01541%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for RD01541: 2
2025-12-05 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: LG38925
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG38925%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for LG38925: 2
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: ME55012
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME55012%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for ME55012: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: BZ67729
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ67729%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for BZ67729: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: YY81592
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY81592%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for YY81592: 2
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: RL30055
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL30055%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for RL30055: 2
2025-12-05 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE73930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD91819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: UJ58840
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ58840%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for UJ58840: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: UW43459
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW43459%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for UW43459: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: HE14591
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE14591%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for HE14591: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: FN45149
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN45149%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for FN45149: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: FR46544
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR46544%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for FR46544: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: GY05920
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05920%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for GY05920: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: LZ25760
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for LZ25760: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: LJ31418
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ31418%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for LJ31418: 2
2025-12-05 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: LC75802
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC75802%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for LC75802: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: MJ69210
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ69210%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for MJ69210: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: KN71804
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN71804%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for KN71804: 2
2025-12-05 21:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK22503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: UC23056
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC23056%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for UC23056: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: PY09316
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY09316%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for PY09316: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: JX07186
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX07186%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for JX07186: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: BJ61163
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ61163%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for BJ61163: 2
2025-12-05 21:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: DJ97439
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ97439%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for DJ97439: 0
2025-12-05 21:00:49 [auto1.it] INFO: Found listing with ID: RX64693
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX64693%27 HTTP/1.1" 200 None
2025-12-05 21:00:49 [auto1.it] INFO: Scrape type for RX64693: 0
2025-12-05 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS31369/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP94413> (referer: https://www.auto1.com/v1/car-details-view/BP94413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b9a63c-68b8-5028-9da4-17172a234648 with identifier: BP94413
2025-12-05 21:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b9a63c-68b8-5028-9da4-17172a234648 with scrape type 2
2025-12-05 21:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b9a63c-68b8-5028-9da4-17172a234648 with scrape type 2
2025-12-05 21:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f4b9a63c-68b8-5028-9da4-17172a234648, identifier: BP94413
2025-12-05 21:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f4b9a63c-68b8-5028-9da4-17172a234648 with identifier: BP94413
2025-12-05 21:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f4b9a63c-68b8-5028-9da4-17172a234648 with identifier: BP94413
2025-12-05 21:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f4b9a63c-68b8-5028-9da4-17172a234648 with identifier: BP94413 to the API
2025-12-05 21:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP94413>
{'auction_title': '',
'c_o_2_emission_value': 203,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 421,
'expiration_date': '2025-12-06T16:30:33Z',
'fuel_type': 'petrol',
'id': 'f4b9a63c-68b8-5028-9da4-17172a234648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP94413',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 31776,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 45 AMG S 4Matic',
'transmission': 'automatic',
'trim': 'S 4Matic',
'year': 2021}
2025-12-05 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP94413%27 HTTP/1.1" 200 None
2025-12-05 21:00:50 [auto1.it] INFO: Saving data for BP94413: {'auction_closing_time': 1765038633.0, 'created_time': 1764878796.068403, 'last_price_update_time': 1764968450.626735}
2025-12-05 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP94413') HTTP/1.1" 204 0
2025-12-05 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG06923> (referer: https://www.auto1.com/v1/car-details-view/CG06923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR86350> (referer: https://www.auto1.com/v1/car-details-view/KR86350/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV77593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV10123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF58021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985f4f75-0c2c-5442-a224-d90c8c0d1e7a with identifier: CG06923
2025-12-05 21:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985f4f75-0c2c-5442-a224-d90c8c0d1e7a with scrape type 2
2025-12-05 21:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 985f4f75-0c2c-5442-a224-d90c8c0d1e7a with scrape type 2
2025-12-05 21:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 985f4f75-0c2c-5442-a224-d90c8c0d1e7a, identifier: CG06923
2025-12-05 21:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 985f4f75-0c2c-5442-a224-d90c8c0d1e7a with identifier: CG06923
2025-12-05 21:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 985f4f75-0c2c-5442-a224-d90c8c0d1e7a with identifier: CG06923
2025-12-05 21:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 985f4f75-0c2c-5442-a224-d90c8c0d1e7a with identifier: CG06923 to the API
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CG06923>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 192,
'expiration_date': '2025-12-06T16:33:46Z',
'fuel_type': 'petrol',
'id': '985f4f75-0c2c-5442-a224-d90c8c0d1e7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG06923',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'MINI',
'model': 'MINI',
'odometer': 126906,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG06923%27 HTTP/1.1" 200 None
2025-12-05 21:00:51 [auto1.it] INFO: Saving data for CG06923: {'auction_closing_time': 1765038826.0, 'created_time': 1764878866.910427, 'last_price_update_time': 1764968451.417088}
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CG06923') HTTP/1.1" 204 0
2025-12-05 21:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e45c4e2-a52d-5b55-9391-91cf80616d72 with identifier: KR86350
2025-12-05 21:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e45c4e2-a52d-5b55-9391-91cf80616d72 with scrape type 2
2025-12-05 21:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e45c4e2-a52d-5b55-9391-91cf80616d72 with scrape type 2
2025-12-05 21:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e45c4e2-a52d-5b55-9391-91cf80616d72, identifier: KR86350
2025-12-05 21:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e45c4e2-a52d-5b55-9391-91cf80616d72 with identifier: KR86350
2025-12-05 21:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e45c4e2-a52d-5b55-9391-91cf80616d72 with identifier: KR86350
2025-12-05 21:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e45c4e2-a52d-5b55-9391-91cf80616d72 with identifier: KR86350 to the API
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR86350>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 220,
'expiration_date': '2025-12-06T16:28:11Z',
'fuel_type': 'diesel',
'id': '6e45c4e2-a52d-5b55-9391-91cf80616d72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR86350',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 29039,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2023}
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR86350%27 HTTP/1.1" 200 None
2025-12-05 21:00:51 [auto1.it] INFO: Saving data for KR86350: {'auction_closing_time': 1765038491.0, 'created_time': 1764878813.553969, 'last_price_update_time': 1764968451.881218}
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR86350') HTTP/1.1" 204 0
2025-12-05 21:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM86600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS04727> (referer: https://www.auto1.com/v1/car-details-view/XS04727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB43955> (referer: https://www.auto1.com/v1/car-details-view/UB43955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 232936ab-6f9e-5438-a553-fb776e146587 with identifier: XS04727
2025-12-05 21:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232936ab-6f9e-5438-a553-fb776e146587 with scrape type 2
2025-12-05 21:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 232936ab-6f9e-5438-a553-fb776e146587 with scrape type 2
2025-12-05 21:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 232936ab-6f9e-5438-a553-fb776e146587, identifier: XS04727
2025-12-05 21:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 232936ab-6f9e-5438-a553-fb776e146587 with identifier: XS04727
2025-12-05 21:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 232936ab-6f9e-5438-a553-fb776e146587 with identifier: XS04727
2025-12-05 21:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2025-12-05 21:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 232936ab-6f9e-5438-a553-fb776e146587 spider: auto1.it
2025-12-05 21:00:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 232936ab-6f9e-5438-a553-fb776e146587 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
'c_o_2_emission_value': 232,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2025-12-06T16:26:10Z',
'fuel_type': 'diesel',
'id': '232936ab-6f9e-5438-a553-fb776e146587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS04727',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 51158,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-17',
'seats_number': 8,
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi L1 Titanium X',
'transmission': 'automatic',
'trim': 'L1 Titanium X',
'year': 2023}
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS04727%27 HTTP/1.1" 200 None
2025-12-05 21:00:52 [auto1.it] INFO: Saving data for XS04727: {'auction_closing_time': 1765038370.0, 'created_time': 1764878743.574574, 'last_price_update_time': 1764968452.320815}
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XS04727') HTTP/1.1" 204 0
2025-12-05 21:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ac52e16-76d0-5495-bc81-bbe6887edfaf with identifier: UB43955
2025-12-05 21:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ac52e16-76d0-5495-bc81-bbe6887edfaf with scrape type 2
2025-12-05 21:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ac52e16-76d0-5495-bc81-bbe6887edfaf with scrape type 2
2025-12-05 21:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ac52e16-76d0-5495-bc81-bbe6887edfaf, identifier: UB43955
2025-12-05 21:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ac52e16-76d0-5495-bc81-bbe6887edfaf with identifier: UB43955
2025-12-05 21:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ac52e16-76d0-5495-bc81-bbe6887edfaf with identifier: UB43955
2025-12-05 21:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2025-12-05 21:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5ac52e16-76d0-5495-bc81-bbe6887edfaf spider: auto1.it
2025-12-05 21:00:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5ac52e16-76d0-5495-bc81-bbe6887edfaf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:27:28Z',
'fuel_type': 'petrol',
'id': '5ac52e16-76d0-5495-bc81-bbe6887edfaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB43955',
'listing': 'auction',
'location': 'IT, Segrate',
'make': 'Ford',
'model': 'Transit Connect',
'odometer': 58029,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-29',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit Connect 1.0 EcoBoost Fourgon L2 Trend',
'transmission': 'manual',
'trim': 'Fourgon L2 Trend',
'year': 2020}
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB43955%27 HTTP/1.1" 200 None
2025-12-05 21:00:52 [auto1.it] INFO: Saving data for UB43955: {'auction_closing_time': 1765038448.0, 'created_time': 1764878666.64706, 'last_price_update_time': 1764968452.641806}
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB43955') HTTP/1.1" 204 0
2025-12-05 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ59063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW28889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL30055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK20818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU53329> (referer: https://www.auto1.com/v1/car-details-view/HU53329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa3e619f-afa3-59bc-9635-cb7453cb763a with identifier: HU53329
2025-12-05 21:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa3e619f-afa3-59bc-9635-cb7453cb763a with scrape type 2
2025-12-05 21:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa3e619f-afa3-59bc-9635-cb7453cb763a with scrape type 2
2025-12-05 21:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa3e619f-afa3-59bc-9635-cb7453cb763a, identifier: HU53329
2025-12-05 21:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa3e619f-afa3-59bc-9635-cb7453cb763a with identifier: HU53329
2025-12-05 21:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa3e619f-afa3-59bc-9635-cb7453cb763a with identifier: HU53329
2025-12-05 21:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa3e619f-afa3-59bc-9635-cb7453cb763a with identifier: HU53329 to the API
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HU53329>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2025-12-06T16:53:18Z',
'fuel_type': 'diesel',
'id': 'aa3e619f-afa3-59bc-9635-cb7453cb763a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU53329',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 57579,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53329%27 HTTP/1.1" 200 None
2025-12-05 21:00:53 [auto1.it] INFO: Saving data for HU53329: {'auction_closing_time': 1765039998.0, 'created_time': 1764878844.439097, 'last_price_update_time': 1764968453.463255}
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU53329') HTTP/1.1" 204 0
2025-12-05 21:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ61163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK22503> (referer: https://www.auto1.com/v1/car-details-view/XK22503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ31418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 906994fb-39b5-5b6e-a67c-7d62f8bfe595 with identifier: XK22503
2025-12-05 21:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 906994fb-39b5-5b6e-a67c-7d62f8bfe595 with scrape type 2
2025-12-05 21:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 906994fb-39b5-5b6e-a67c-7d62f8bfe595 with scrape type 2
2025-12-05 21:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 906994fb-39b5-5b6e-a67c-7d62f8bfe595, identifier: XK22503
2025-12-05 21:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 906994fb-39b5-5b6e-a67c-7d62f8bfe595 with identifier: XK22503
2025-12-05 21:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 906994fb-39b5-5b6e-a67c-7d62f8bfe595 with identifier: XK22503
2025-12-05 21:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 906994fb-39b5-5b6e-a67c-7d62f8bfe595 with identifier: XK22503 to the API
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK22503>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 106,
'expiration_date': '2025-12-06T16:34:18Z',
'fuel_type': 'petrol',
'id': '906994fb-39b5-5b6e-a67c-7d62f8bfe595',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK22503',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'MG',
'model': 'ZS',
'odometer': 5916,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'MG ZS 1.5 VTi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2024}
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK22503%27 HTTP/1.1" 200 None
2025-12-05 21:00:53 [auto1.it] INFO: Saving data for XK22503: {'auction_closing_time': 1765038858.0, 'created_time': 1764878604.35753, 'last_price_update_time': 1764968453.978368}
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XK22503') HTTP/1.1" 204 0
2025-12-05 21:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD91819> (referer: https://www.auto1.com/v1/car-details-view/MD91819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS31369> (referer: https://www.auto1.com/v1/car-details-view/ZS31369/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE73930> (referer: https://www.auto1.com/v1/car-details-view/LE73930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4149fac-1450-50f3-831e-e1799de99969 with identifier: MD91819
2025-12-05 21:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4149fac-1450-50f3-831e-e1799de99969 with scrape type 2
2025-12-05 21:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4149fac-1450-50f3-831e-e1799de99969 with scrape type 2
2025-12-05 21:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4149fac-1450-50f3-831e-e1799de99969, identifier: MD91819
2025-12-05 21:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369
2025-12-05 21:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0be77a2c-4c77-56fc-9178-17d97e4fe893 with scrape type 2
2025-12-05 21:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0be77a2c-4c77-56fc-9178-17d97e4fe893 with scrape type 2
2025-12-05 21:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0be77a2c-4c77-56fc-9178-17d97e4fe893, identifier: ZS31369
2025-12-05 21:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4149fac-1450-50f3-831e-e1799de99969 with identifier: MD91819
2025-12-05 21:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4149fac-1450-50f3-831e-e1799de99969 with identifier: MD91819
2025-12-05 21:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4149fac-1450-50f3-831e-e1799de99969 with identifier: MD91819 to the API
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD91819>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:23:59Z',
'fuel_type': 'petrol',
'id': 'b4149fac-1450-50f3-831e-e1799de99969',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD91819',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Citroen',
'model': 'C3',
'odometer': 63174,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech YOU',
'transmission': 'manual',
'trim': 'YOU',
'year': 2022}
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD91819%27 HTTP/1.1" 200 None
2025-12-05 21:00:54 [auto1.it] INFO: Saving data for MD91819: {'auction_closing_time': 1765038239.0, 'created_time': 1764878853.251836, 'last_price_update_time': 1764968454.634282}
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD91819') HTTP/1.1" 204 0
2025-12-05 21:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369
2025-12-05 21:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369
2025-12-05 21:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369 to the API
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZS31369>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:42:00Z',
'fuel_type': 'petrol',
'id': '0be77a2c-4c77-56fc-9178-17d97e4fe893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS31369',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 58568,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS31369%27 HTTP/1.1" 200 None
2025-12-05 21:00:54 [auto1.it] INFO: Saving data for ZS31369: {'auction_closing_time': 1765039320.0, 'created_time': 1762891628.929118, 'last_price_update_time': 1764968454.937054}
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZS31369') HTTP/1.1" 204 0
2025-12-05 21:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY81592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444350c2-0e03-51de-b523-a4ec511f0114 with identifier: LE73930
2025-12-05 21:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444350c2-0e03-51de-b523-a4ec511f0114 with scrape type 2
2025-12-05 21:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 444350c2-0e03-51de-b523-a4ec511f0114 with scrape type 2
2025-12-05 21:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 444350c2-0e03-51de-b523-a4ec511f0114, identifier: LE73930
2025-12-05 21:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 444350c2-0e03-51de-b523-a4ec511f0114 with identifier: LE73930
2025-12-05 21:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 444350c2-0e03-51de-b523-a4ec511f0114 with identifier: LE73930
2025-12-05 21:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 444350c2-0e03-51de-b523-a4ec511f0114 with identifier: LE73930 to the API
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LE73930>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:23:51Z',
'fuel_type': 'diesel',
'id': '444350c2-0e03-51de-b523-a4ec511f0114',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE73930',
'listing': 'auction',
'location': 'Milano',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 112410,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2017}
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE73930%27 HTTP/1.1" 200 None
2025-12-05 21:00:55 [auto1.it] INFO: Saving data for LE73930: {'auction_closing_time': 1765038231.0, 'created_time': 1764878838.077993, 'last_price_update_time': 1764968455.322273}
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE73930') HTTP/1.1" 204 0
2025-12-05 21:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG38925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF58021> (referer: https://www.auto1.com/v1/car-details-view/NF58021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e8afe5-4343-56c6-a7d5-0001786f6b09 with identifier: NF58021
2025-12-05 21:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e8afe5-4343-56c6-a7d5-0001786f6b09 with scrape type 2
2025-12-05 21:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e8afe5-4343-56c6-a7d5-0001786f6b09 with scrape type 2
2025-12-05 21:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7e8afe5-4343-56c6-a7d5-0001786f6b09, identifier: NF58021
2025-12-05 21:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7e8afe5-4343-56c6-a7d5-0001786f6b09 with identifier: NF58021
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:00:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2025-12-05 21:00:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7e8afe5-4343-56c6-a7d5-0001786f6b09 with identifier: NF58021
2025-12-05 21:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163701 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163701
2025-12-05 21:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a7e8afe5-4343-56c6-a7d5-0001786f6b09 spider: auto1.it
2025-12-05 21:00:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a7e8afe5-4343-56c6-a7d5-0001786f6b09 due to rule: high_mileage_for_country.json, error: 163701 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163701
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2025-12-06T16:30:40Z',
'fuel_type': 'diesel',
'id': 'a7e8afe5-4343-56c6-a7d5-0001786f6b09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF58021',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 163701,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 2.0 M-Jet Upland 4WD',
'transmission': 'automatic',
'trim': 'Upland 4WD',
'year': 2017}
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF58021%27 HTTP/1.1" 200 None
2025-12-05 21:00:56 [auto1.it] INFO: Saving data for NF58021: {'auction_closing_time': 1765038640.0, 'created_time': 1764878699.95002, 'last_price_update_time': 1764968456.246479}
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF58021') HTTP/1.1" 204 0
2025-12-05 21:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD01541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM86600> (referer: https://www.auto1.com/v1/car-details-view/GM86600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU99942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV10123> (referer: https://www.auto1.com/v1/car-details-view/PV10123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93eec5e-1792-5956-9326-07781f4cf1ce with identifier: GM86600
2025-12-05 21:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93eec5e-1792-5956-9326-07781f4cf1ce with scrape type 2
2025-12-05 21:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c93eec5e-1792-5956-9326-07781f4cf1ce with scrape type 2
2025-12-05 21:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c93eec5e-1792-5956-9326-07781f4cf1ce, identifier: GM86600
2025-12-05 21:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c93eec5e-1792-5956-9326-07781f4cf1ce with identifier: GM86600
2025-12-05 21:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c93eec5e-1792-5956-9326-07781f4cf1ce with identifier: GM86600
2025-12-05 21:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c93eec5e-1792-5956-9326-07781f4cf1ce with identifier: GM86600 to the API
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM86600>
{'auction_title': '',
'c_o_2_emission_value': 177,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 280,
'expiration_date': '2025-12-06T16:38:09Z',
'fuel_type': 'petrol',
'id': 'c93eec5e-1792-5956-9326-07781f4cf1ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM86600',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 71988,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.0 Turbo Veloce',
'transmission': 'automatic',
'trim': 'Veloce',
'year': 2019}
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86600%27 HTTP/1.1" 200 None
2025-12-05 21:00:56 [auto1.it] INFO: Saving data for GM86600: {'auction_closing_time': 1765039089.0, 'created_time': 1764878804.063665, 'last_price_update_time': 1764968456.735751}
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM86600') HTTP/1.1" 204 0
2025-12-05 21:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154 with identifier: PV10123
2025-12-05 21:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154 with scrape type 2
2025-12-05 21:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154 with scrape type 2
2025-12-05 21:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154, identifier: PV10123
2025-12-05 21:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK20818> (referer: https://www.auto1.com/v1/car-details-view/DK20818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154 with identifier: PV10123
2025-12-05 21:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154 with identifier: PV10123
2025-12-05 21:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154 with identifier: PV10123 to the API
2025-12-05 21:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PV10123>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:01:55Z',
'fuel_type': 'petrol',
'id': '63c2a5d2-ec6f-55aa-ba74-7d5fe7a60154',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV10123',
'listing': 'auction',
'location': 'IT, Ardea (RM)',
'make': 'Smart',
'model': 'fortwo',
'odometer': 108063,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-21',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV10123%27 HTTP/1.1" 200 None
2025-12-05 21:00:57 [auto1.it] INFO: Saving data for PV10123: {'auction_closing_time': 1765036915.0, 'created_time': 1764878660.136498, 'last_price_update_time': 1764968457.121789}
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV10123') HTTP/1.1" 204 0
2025-12-05 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV77593> (referer: https://www.auto1.com/v1/car-details-view/DV77593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e57831b4-1a59-5b89-8b19-16f01beba844 with identifier: DK20818
2025-12-05 21:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e57831b4-1a59-5b89-8b19-16f01beba844 with scrape type 2
2025-12-05 21:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e57831b4-1a59-5b89-8b19-16f01beba844 with scrape type 2
2025-12-05 21:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e57831b4-1a59-5b89-8b19-16f01beba844, identifier: DK20818
2025-12-05 21:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e57831b4-1a59-5b89-8b19-16f01beba844 with identifier: DK20818
2025-12-05 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e57831b4-1a59-5b89-8b19-16f01beba844 with identifier: DK20818
2025-12-05 21:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e57831b4-1a59-5b89-8b19-16f01beba844 with identifier: DK20818 to the API
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DK20818>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 355,
'expiration_date': '2025-12-06T16:45:16Z',
'fuel_type': 'petrol',
'id': 'e57831b4-1a59-5b89-8b19-16f01beba844',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK20818',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Audi',
'model': 'S5 Sportback',
'odometer': 64248,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK20818%27 HTTP/1.1" 200 None
2025-12-05 21:00:57 [auto1.it] INFO: Saving data for DK20818: {'auction_closing_time': 1765039516.0, 'created_time': 1764878833.852133, 'last_price_update_time': 1764968457.509299}
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK20818') HTTP/1.1" 204 0
2025-12-05 21:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce7dc094-234c-5d1d-90c2-172c4a4557da with identifier: DV77593
2025-12-05 21:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7dc094-234c-5d1d-90c2-172c4a4557da with scrape type 2
2025-12-05 21:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce7dc094-234c-5d1d-90c2-172c4a4557da with scrape type 2
2025-12-05 21:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce7dc094-234c-5d1d-90c2-172c4a4557da, identifier: DV77593
2025-12-05 21:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce7dc094-234c-5d1d-90c2-172c4a4557da with identifier: DV77593
2025-12-05 21:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce7dc094-234c-5d1d-90c2-172c4a4557da with identifier: DV77593
2025-12-05 21:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce7dc094-234c-5d1d-90c2-172c4a4557da with identifier: DV77593 to the API
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV77593>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2025-12-06T16:44:22Z',
'fuel_type': 'petrol',
'id': 'ce7dc094-234c-5d1d-90c2-172c4a4557da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV77593',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 93879,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2018}
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV77593%27 HTTP/1.1" 200 None
2025-12-05 21:00:57 [auto1.it] INFO: Saving data for DV77593: {'auction_closing_time': 1765039462.0, 'created_time': 1764792026.503464, 'last_price_update_time': 1764968457.911322}
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV77593') HTTP/1.1" 204 0
2025-12-05 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL30055> (referer: https://www.auto1.com/v1/car-details-view/RL30055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ61163> (referer: https://www.auto1.com/v1/car-details-view/BJ61163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ59063> (referer: https://www.auto1.com/v1/car-details-view/LJ59063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW28889> (referer: https://www.auto1.com/v1/car-details-view/RW28889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM98126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055
2025-12-05 21:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c916c6a-09e2-541f-879e-27ae56b589a9 with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c916c6a-09e2-541f-879e-27ae56b589a9 with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c916c6a-09e2-541f-879e-27ae56b589a9, identifier: RL30055
2025-12-05 21:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055
2025-12-05 21:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055
2025-12-05 21:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055 to the API
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL30055>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 218,
'expiration_date': '2025-12-06T16:43:46Z',
'fuel_type': 'hybrid',
'id': '6c916c6a-09e2-541f-879e-27ae56b589a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL30055',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 22192,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL30055%27 HTTP/1.1" 200 None
2025-12-05 21:00:58 [auto1.it] INFO: Saving data for RL30055: {'auction_closing_time': 1765039426.0, 'created_time': 1764792036.468562, 'last_price_update_time': 1764968458.443247}
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL30055') HTTP/1.1" 204 0
2025-12-05 21:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9851edef-5bfa-59ac-a026-6028ebc5254f with identifier: BJ61163
2025-12-05 21:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9851edef-5bfa-59ac-a026-6028ebc5254f with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9851edef-5bfa-59ac-a026-6028ebc5254f with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9851edef-5bfa-59ac-a026-6028ebc5254f, identifier: BJ61163
2025-12-05 21:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4721b18b-b70d-5504-915c-d436eae7be4f with identifier: LJ59063
2025-12-05 21:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4721b18b-b70d-5504-915c-d436eae7be4f with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4721b18b-b70d-5504-915c-d436eae7be4f with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4721b18b-b70d-5504-915c-d436eae7be4f, identifier: LJ59063
2025-12-05 21:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab1e3e5-f9e7-55cb-b7b6-e12569b43037 with identifier: RW28889
2025-12-05 21:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab1e3e5-f9e7-55cb-b7b6-e12569b43037 with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab1e3e5-f9e7-55cb-b7b6-e12569b43037 with scrape type 2
2025-12-05 21:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ab1e3e5-f9e7-55cb-b7b6-e12569b43037, identifier: RW28889
2025-12-05 21:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9851edef-5bfa-59ac-a026-6028ebc5254f with identifier: BJ61163
2025-12-05 21:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9851edef-5bfa-59ac-a026-6028ebc5254f with identifier: BJ61163
2025-12-05 21:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9851edef-5bfa-59ac-a026-6028ebc5254f with identifier: BJ61163 to the API
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ61163>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:16:37Z',
'fuel_type': 'diesel',
'id': '9851edef-5bfa-59ac-a026-6028ebc5254f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ61163',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Peugeot',
'model': '3008',
'odometer': 129100,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2017}
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ61163%27 HTTP/1.1" 200 None
2025-12-05 21:00:59 [auto1.it] INFO: Saving data for BJ61163: {'auction_closing_time': 1765037797.0, 'created_time': 1762373139.687789, 'last_price_update_time': 1764968459.053274}
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ61163') HTTP/1.1" 204 0
2025-12-05 21:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4721b18b-b70d-5504-915c-d436eae7be4f with identifier: LJ59063
2025-12-05 21:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4721b18b-b70d-5504-915c-d436eae7be4f with identifier: LJ59063
2025-12-05 21:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4721b18b-b70d-5504-915c-d436eae7be4f with identifier: LJ59063 to the API
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ59063>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:55:34Z',
'fuel_type': 'diesel',
'id': '4721b18b-b70d-5504-915c-d436eae7be4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ59063',
'listing': 'auction',
'location': 'IT, Massa',
'make': 'Ford',
'model': 'B-Max',
'odometer': 122266,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford B-Max 1.5 TDCi Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2017}
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ59063%27 HTTP/1.1" 200 None
2025-12-05 21:00:59 [auto1.it] INFO: Saving data for LJ59063: {'auction_closing_time': 1765040134.0, 'created_time': 1764878676.40041, 'last_price_update_time': 1764968459.341246}
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LJ59063') HTTP/1.1" 204 0
2025-12-05 21:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ab1e3e5-f9e7-55cb-b7b6-e12569b43037 with identifier: RW28889
2025-12-05 21:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ab1e3e5-f9e7-55cb-b7b6-e12569b43037 with identifier: RW28889
2025-12-05 21:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ab1e3e5-f9e7-55cb-b7b6-e12569b43037 with identifier: RW28889 to the API
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RW28889>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:17:20Z',
'fuel_type': 'petrol',
'id': '7ab1e3e5-f9e7-55cb-b7b6-e12569b43037',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW28889',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 40718,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2023}
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW28889%27 HTTP/1.1" 200 None
2025-12-05 21:00:59 [auto1.it] INFO: Saving data for RW28889: {'auction_closing_time': 1765037840.0, 'created_time': 1764878796.402332, 'last_price_update_time': 1764968459.658419}
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RW28889') HTTP/1.1" 204 0
2025-12-05 21:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY50818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ31418> (referer: https://www.auto1.com/v1/car-details-view/LJ31418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06e2077a-6910-5ac7-9cf3-a646df2774d2 with identifier: LJ31418
2025-12-05 21:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06e2077a-6910-5ac7-9cf3-a646df2774d2 with scrape type 2
2025-12-05 21:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06e2077a-6910-5ac7-9cf3-a646df2774d2 with scrape type 2
2025-12-05 21:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06e2077a-6910-5ac7-9cf3-a646df2774d2, identifier: LJ31418
2025-12-05 21:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06e2077a-6910-5ac7-9cf3-a646df2774d2 with identifier: LJ31418
2025-12-05 21:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06e2077a-6910-5ac7-9cf3-a646df2774d2 with identifier: LJ31418
2025-12-05 21:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06e2077a-6910-5ac7-9cf3-a646df2774d2 with identifier: LJ31418 to the API
2025-12-05 21:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ31418>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:15:47Z',
'fuel_type': 'diesel',
'id': '06e2077a-6910-5ac7-9cf3-a646df2774d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ31418',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 45058,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2022}
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ31418%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Saving data for LJ31418: {'auction_closing_time': 1765037747.0, 'created_time': 1764878850.165576, 'last_price_update_time': 1764968460.191301}
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LJ31418') HTTP/1.1" 204 0
2025-12-05 21:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY81592> (referer: https://www.auto1.com/v1/car-details-view/YY81592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG42514> (referer: https://www.auto1.com/v1/car-details-view/LG42514/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:00 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: YH36098
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH36098%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for YH36098: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: HT90813
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT90813%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for HT90813: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: HX83454
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX83454%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for HX83454: 2
2025-12-05 21:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: LG15612
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG15612%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for LG15612: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: UV47695
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for UV47695: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: BR12056
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR12056%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for BR12056: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: GE92322
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE92322%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for GE92322: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: LR58377
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR58377%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for LR58377: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: BT39914
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT39914%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for BT39914: 0
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: FB33049
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB33049%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for FB33049: 2
2025-12-05 21:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 825baea6-091c-5f57-89c6-162d73790598 with identifier: YY81592
2025-12-05 21:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 825baea6-091c-5f57-89c6-162d73790598 with scrape type 2
2025-12-05 21:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 825baea6-091c-5f57-89c6-162d73790598 with scrape type 2
2025-12-05 21:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 825baea6-091c-5f57-89c6-162d73790598, identifier: YY81592
2025-12-05 21:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f513346-975c-5dc6-81e3-1e5673535353 with identifier: LG42514
2025-12-05 21:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f513346-975c-5dc6-81e3-1e5673535353 with scrape type 2
2025-12-05 21:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f513346-975c-5dc6-81e3-1e5673535353 with scrape type 2
2025-12-05 21:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f513346-975c-5dc6-81e3-1e5673535353, identifier: LG42514
2025-12-05 21:01:00 [auto1.it] INFO: Found listing with ID: GZ38175
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ38175%27 HTTP/1.1" 200 None
2025-12-05 21:01:00 [auto1.it] INFO: Scrape type for GZ38175: 2
2025-12-05 21:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 825baea6-091c-5f57-89c6-162d73790598 with identifier: YY81592
2025-12-05 21:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 825baea6-091c-5f57-89c6-162d73790598 with identifier: YY81592
2025-12-05 21:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 825baea6-091c-5f57-89c6-162d73790598 with identifier: YY81592 to the API
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY81592>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:23:47Z',
'fuel_type': 'petrol',
'id': '825baea6-091c-5f57-89c6-162d73790598',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY81592',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 107669,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY81592%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Saving data for YY81592: {'auction_closing_time': 1765038227.0, 'created_time': 1764878585.653214, 'last_price_update_time': 1764968461.215751}
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY81592') HTTP/1.1" 204 0
2025-12-05 21:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f513346-975c-5dc6-81e3-1e5673535353 with identifier: LG42514
2025-12-05 21:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f513346-975c-5dc6-81e3-1e5673535353 with identifier: LG42514
2025-12-05 21:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f513346-975c-5dc6-81e3-1e5673535353 with identifier: LG42514 to the API
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG42514>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:21:05Z',
'fuel_type': 'diesel',
'id': '3f513346-975c-5dc6-81e3-1e5673535353',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG42514',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Audi',
'model': 'A4',
'odometer': 127224,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG42514%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Saving data for LG42514: {'auction_closing_time': 1765038065.0, 'created_time': 1764237758.224823, 'last_price_update_time': 1764968461.669053}
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG42514') HTTP/1.1" 204 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: TF80780
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF80780%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for TF80780: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: GR38482
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR38482%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for GR38482: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: FE68009
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE68009%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for FE68009: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: SC05973
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05973%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for SC05973: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: BF65638
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF65638%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for BF65638: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: JD19980
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD19980%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for JD19980: 2
2025-12-05 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG38925> (referer: https://www.auto1.com/v1/car-details-view/LG38925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY32891> (referer: https://www.auto1.com/v1/car-details-view/RY32891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN71804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD01541> (referer: https://www.auto1.com/v1/car-details-view/RD01541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU99942> (referer: https://www.auto1.com/v1/car-details-view/PU99942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: LM12647
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for LM12647: 2
2025-12-05 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: GW70915
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW70915%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for GW70915: 2
2025-12-05 21:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: YN88087
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN88087%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for YN88087: 2
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: TS66392
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS66392%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for TS66392: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: BL60160
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL60160%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for BL60160: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: VU49285
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU49285%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for VU49285: 0
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: RK87672
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK87672%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for RK87672: 2
2025-12-05 21:01:01 [auto1.it] INFO: Found listing with ID: AJ43419
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ43419%27 HTTP/1.1" 200 None
2025-12-05 21:01:01 [auto1.it] INFO: Scrape type for AJ43419: 2
2025-12-05 21:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e with identifier: LG38925
2025-12-05 21:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e with scrape type 2
2025-12-05 21:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e with scrape type 2
2025-12-05 21:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e, identifier: LG38925
2025-12-05 21:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f21ca395-d2d1-5674-ab0e-ad587c145b58 with identifier: RY32891
2025-12-05 21:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f21ca395-d2d1-5674-ab0e-ad587c145b58 with scrape type 2
2025-12-05 21:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f21ca395-d2d1-5674-ab0e-ad587c145b58 with scrape type 2
2025-12-05 21:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f21ca395-d2d1-5674-ab0e-ad587c145b58, identifier: RY32891
2025-12-05 21:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ba314f-e105-5564-be13-5133dafe9604 with identifier: RD01541
2025-12-05 21:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ba314f-e105-5564-be13-5133dafe9604 with scrape type 2
2025-12-05 21:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91ba314f-e105-5564-be13-5133dafe9604 with scrape type 2
2025-12-05 21:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91ba314f-e105-5564-be13-5133dafe9604, identifier: RD01541
2025-12-05 21:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ab4d73-3705-5668-8e75-e59cd1a9f4af with identifier: PU99942
2025-12-05 21:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ab4d73-3705-5668-8e75-e59cd1a9f4af with scrape type 2
2025-12-05 21:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ab4d73-3705-5668-8e75-e59cd1a9f4af with scrape type 2
2025-12-05 21:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40ab4d73-3705-5668-8e75-e59cd1a9f4af, identifier: PU99942
2025-12-05 21:01:02 [auto1.it] INFO: Found listing with ID: EV89317
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV89317%27 HTTP/1.1" 200 None
2025-12-05 21:01:02 [auto1.it] INFO: Scrape type for EV89317: 0
2025-12-05 21:01:02 [auto1.it] INFO: Found listing with ID: RK40358
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK40358%27 HTTP/1.1" 200 None
2025-12-05 21:01:02 [auto1.it] INFO: Scrape type for RK40358: 2
2025-12-05 21:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e with identifier: LG38925
2025-12-05 21:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e with identifier: LG38925
2025-12-05 21:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e with identifier: LG38925 to the API
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG38925>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2025-12-06T16:06:24Z',
'fuel_type': 'diesel',
'id': '1e7a4746-bd8c-5ec4-a2cf-0eace78ee52e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG38925',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 97316,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Executive 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Executive 4Motion BlueMotion',
'year': 2017}
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG38925%27 HTTP/1.1" 200 None
2025-12-05 21:01:02 [auto1.it] INFO: Saving data for LG38925: {'auction_closing_time': 1765037184.0, 'created_time': 1764878587.940839, 'last_price_update_time': 1764968462.670017}
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG38925') HTTP/1.1" 204 0
2025-12-05 21:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f21ca395-d2d1-5674-ab0e-ad587c145b58 with identifier: RY32891
2025-12-05 21:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f21ca395-d2d1-5674-ab0e-ad587c145b58 with identifier: RY32891
2025-12-05 21:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f21ca395-d2d1-5674-ab0e-ad587c145b58 with identifier: RY32891 to the API
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY32891>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 178,
'expiration_date': '2025-12-06T16:08:38Z',
'fuel_type': 'petrol',
'id': 'f21ca395-d2d1-5674-ab0e-ad587c145b58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY32891',
'listing': 'auction',
'location': 'IT, Abbiategrasso',
'make': 'BMW',
'model': '1er',
'odometer': 31100,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 120i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2023}
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY32891%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Saving data for RY32891: {'auction_closing_time': 1765037318.0, 'created_time': 1764878873.465507, 'last_price_update_time': 1764968463.058803}
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY32891') HTTP/1.1" 204 0
2025-12-05 21:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91ba314f-e105-5564-be13-5133dafe9604 with identifier: RD01541
2025-12-05 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91ba314f-e105-5564-be13-5133dafe9604 with identifier: RD01541
2025-12-05 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2025-12-05 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 91ba314f-e105-5564-be13-5133dafe9604 spider: auto1.it
2025-12-05 21:01:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 91ba314f-e105-5564-be13-5133dafe9604 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:38:09Z',
'fuel_type': 'petrol',
'id': '91ba314f-e105-5564-be13-5133dafe9604',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD01541',
'listing': 'auction',
'location': 'Milazzo',
'make': 'Fiat',
'model': 'Panda',
'odometer': 21262,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-11',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid Cross',
'transmission': 'manual',
'trim': 'Cross',
'year': 2021}
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01541%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Saving data for RD01541: {'auction_closing_time': 1765039089.0, 'created_time': 1764878794.84189, 'last_price_update_time': 1764968463.267712}
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD01541') HTTP/1.1" 204 0
2025-12-05 21:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40ab4d73-3705-5668-8e75-e59cd1a9f4af with identifier: PU99942
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2025-12-05 21:01:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40ab4d73-3705-5668-8e75-e59cd1a9f4af with identifier: PU99942
2025-12-05 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134497 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
134497
2025-12-05 21:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 40ab4d73-3705-5668-8e75-e59cd1a9f4af spider: auto1.it
2025-12-05 21:01:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 40ab4d73-3705-5668-8e75-e59cd1a9f4af due to rule: high_mileage_for_make.json, error: 134497 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
134497
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:40:33Z',
'fuel_type': 'gas',
'id': '40ab4d73-3705-5668-8e75-e59cd1a9f4af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU99942',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Renault',
'model': 'Clio',
'odometer': 134497,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-03',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe LPG Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2021}
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU99942%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Saving data for PU99942: {'auction_closing_time': 1765039233.0, 'created_time': 1764792422.60242, 'last_price_update_time': 1764968463.658326}
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PU99942') HTTP/1.1" 204 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: HG98789
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG98789%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for HG98789: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: AY82882
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY82882%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for AY82882: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: NG74422
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74422%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for NG74422: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: NA63164
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA63164%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for NA63164: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: NZ23957
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ23957%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for NZ23957: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: SE73703
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE73703%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for SE73703: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: EK48901
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK48901%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for EK48901: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: UA95207
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA95207%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for UA95207: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: ZU44303
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU44303%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for ZU44303: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: NE58179
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE58179%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for NE58179: 2
2025-12-05 21:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM98126> (referer: https://www.auto1.com/v1/car-details-view/XM98126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY50818> (referer: https://www.auto1.com/v1/car-details-view/YY50818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: ZC07011
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC07011%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for ZC07011: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: RG65922
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG65922%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for RG65922: 0
2025-12-05 21:01:03 [auto1.it] INFO: Found listing with ID: DY09053
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY09053%27 HTTP/1.1" 200 None
2025-12-05 21:01:03 [auto1.it] INFO: Scrape type for DY09053: 0
2025-12-05 21:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:03 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: XL18907
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL18907%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for XL18907: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: EN94369
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN94369%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for EN94369: 2
2025-12-05 21:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with identifier: XM98126
2025-12-05 21:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with scrape type 2
2025-12-05 21:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with scrape type 2
2025-12-05 21:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d37cc5f1-9fea-5224-8f2e-8d89916f0a29, identifier: XM98126
2025-12-05 21:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 926c10e4-1859-5ecd-95bb-c323285c423a with identifier: YY50818
2025-12-05 21:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 926c10e4-1859-5ecd-95bb-c323285c423a with scrape type 2
2025-12-05 21:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 926c10e4-1859-5ecd-95bb-c323285c423a with scrape type 2
2025-12-05 21:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 926c10e4-1859-5ecd-95bb-c323285c423a, identifier: YY50818
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: TG21070
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG21070%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for TG21070: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: HY15868
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY15868%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for HY15868: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: PR47123
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR47123%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for PR47123: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: PP05492
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP05492%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for PP05492: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: XF13981
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF13981%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for XF13981: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: LG07242
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for LG07242: 2
2025-12-05 21:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with identifier: XM98126
2025-12-05 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with identifier: XM98126
2025-12-05 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195459 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195459
2025-12-05 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 spider: auto1.it
2025-12-05 21:01:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 due to rule: high_mileage_for_country.json, error: 195459 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195459
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:17:51Z',
'fuel_type': 'diesel',
'id': 'd37cc5f1-9fea-5224-8f2e-8d89916f0a29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM98126',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 195459,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 Cross Country 2.0 D3 Plus',
'transmission': 'automatic',
'trim': 'Plus',
'year': 2018}
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Saving data for XM98126: {'auction_closing_time': 1765037871.0, 'created_time': 1764878860.8725, 'last_price_update_time': 1764968464.540528}
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XM98126') HTTP/1.1" 204 0
2025-12-05 21:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 926c10e4-1859-5ecd-95bb-c323285c423a with identifier: YY50818
2025-12-05 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 926c10e4-1859-5ecd-95bb-c323285c423a with identifier: YY50818
2025-12-05 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171630 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171630
2025-12-05 21:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 926c10e4-1859-5ecd-95bb-c323285c423a spider: auto1.it
2025-12-05 21:01:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 926c10e4-1859-5ecd-95bb-c323285c423a due to rule: high_mileage_for_country.json, error: 171630 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171630
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:20:45Z',
'fuel_type': 'diesel',
'id': '926c10e4-1859-5ecd-95bb-c323285c423a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY50818',
'listing': 'auction',
'location': 'IT, Treviso',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 171630,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY50818%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Saving data for YY50818: {'auction_closing_time': 1765038045.0, 'created_time': 1764878665.734343, 'last_price_update_time': 1764968464.841528}
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY50818') HTTP/1.1" 204 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: TZ17283
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ17283%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for TZ17283: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: XD09667
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD09667%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for XD09667: 2
2025-12-05 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM12647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX83454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ38175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD19980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: MT35783
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35783%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for MT35783: 2
2025-12-05 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: YS25498
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS25498%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for YS25498: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: MC45094
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC45094%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for MC45094: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: EN92319
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN92319%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for EN92319: 2
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: VM30492
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM30492%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for VM30492: 0
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: TY94975
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY94975%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for TY94975: 2
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: FN77058
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN77058%27 HTTP/1.1" 200 None
2025-12-05 21:01:04 [auto1.it] INFO: Scrape type for FN77058: 2
2025-12-05 21:01:04 [auto1.it] INFO: Found listing with ID: WC40670
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC40670%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for WC40670: 2
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: RT66786
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT66786%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for RT66786: 2
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: UX08705
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX08705%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for UX08705: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: PM67896
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM67896%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for PM67896: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: PM20495
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM20495%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for PM20495: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: RZ21279
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ21279%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for RZ21279: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: CK46051
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK46051%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for CK46051: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: DH42983
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH42983%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for DH42983: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: TH52637
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH52637%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for TH52637: 2
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: SN76439
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN76439%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for SN76439: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: CB71974
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB71974%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for CB71974: 2
2025-12-05 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB33049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: BG97332
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG97332%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for BG97332: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: WB53951
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB53951%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for WB53951: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: AL52920
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL52920%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for AL52920: 2
2025-12-05 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: SZ44816
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ44816%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for SZ44816: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: FJ98323
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ98323%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for FJ98323: 2
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: AB72839
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB72839%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for AB72839: 2
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: CN91272
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN91272%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for CN91272: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: HN76486
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN76486%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for HN76486: 2
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: CX00629
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX00629%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for CX00629: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: PZ64789
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ64789%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for PZ64789: 2
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: AR79797
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR79797%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for AR79797: 0
2025-12-05 21:01:05 [auto1.it] INFO: Found listing with ID: DK98647
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK98647%27 HTTP/1.1" 200 None
2025-12-05 21:01:05 [auto1.it] INFO: Scrape type for DK98647: 0
2025-12-05 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN88087/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW70915/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK87672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE58179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ43419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK40358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN94369/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:06 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: TX41333
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX41333%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for TX41333: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: HX12723
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX12723%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for HX12723: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: DZ09819
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ09819%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for DZ09819: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: FA30496
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA30496%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for FA30496: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: YK17945
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK17945%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for YK17945: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: GZ43068
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ43068%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for GZ43068: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: SC12614
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC12614%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for SC12614: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: RT10287
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10287%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for RT10287: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: KY20134
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY20134%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for KY20134: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: VF92545
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for VF92545: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: KM95714
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM95714%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for KM95714: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: WF21370
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF21370%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for WF21370: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: LY28002
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY28002%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for LY28002: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: TL25124
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL25124%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for TL25124: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: LN66552
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66552%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for LN66552: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: KK64864
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK64864%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for KK64864: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: EM01211
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM01211%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for EM01211: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: YP00862
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP00862%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for YP00862: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: GZ28194
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ28194%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for GZ28194: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: KX66152
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX66152%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for KX66152: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: YZ61558
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ61558%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for YZ61558: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: NR71771
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR71771%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for NR71771: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: BY98220
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY98220%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for BY98220: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: AW14476
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW14476%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for AW14476: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: HD68470
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD68470%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for HD68470: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: KM04068
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM04068%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for KM04068: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: GG58363
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG58363%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for GG58363: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: VW18274
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW18274%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for VW18274: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: VY71575
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY71575%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for VY71575: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: XK00729
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK00729%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for XK00729: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: PV13069
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV13069%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for PV13069: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: AF20385
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF20385%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for AF20385: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: NM32123
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM32123%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for NM32123: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: JB07830
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB07830%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for JB07830: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: MD14180
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for MD14180: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: KK31902
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK31902%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for KK31902: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: MW43217
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW43217%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for MW43217: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: YW02241
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW02241%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for YW02241: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: JN60892
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN60892%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for JN60892: 0
2025-12-05 21:01:06 [auto1.it] INFO: Found listing with ID: KC21681
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC21681%27 HTTP/1.1" 200 None
2025-12-05 21:01:06 [auto1.it] INFO: Scrape type for KC21681: 0
2025-12-05 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG07242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD09667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT35783/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN92319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY94975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN71804> (referer: https://www.auto1.com/v1/car-details-view/KN71804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB71974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ64789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN77058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a95c83c-c93e-5ba0-b73e-243f0911b273 with identifier: KN71804
2025-12-05 21:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a95c83c-c93e-5ba0-b73e-243f0911b273 with scrape type 2
2025-12-05 21:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a95c83c-c93e-5ba0-b73e-243f0911b273 with scrape type 2
2025-12-05 21:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a95c83c-c93e-5ba0-b73e-243f0911b273, identifier: KN71804
2025-12-05 21:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a95c83c-c93e-5ba0-b73e-243f0911b273 with identifier: KN71804
2025-12-05 21:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a95c83c-c93e-5ba0-b73e-243f0911b273 with identifier: KN71804
2025-12-05 21:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a95c83c-c93e-5ba0-b73e-243f0911b273 with identifier: KN71804 to the API
2025-12-05 21:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KN71804>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2025-12-06T16:59:10Z',
'fuel_type': 'hybrid',
'id': '6a95c83c-c93e-5ba0-b73e-243f0911b273',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN71804',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Renault',
'model': 'Arkana',
'odometer': 33436,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Arkana 1.6 Hybrid E-Tech Engineered',
'transmission': 'automatic',
'trim': 'Engineered',
'year': 2022}
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN71804%27 HTTP/1.1" 200 None
2025-12-05 21:01:08 [auto1.it] INFO: Saving data for KN71804: {'auction_closing_time': 1765040350.0, 'created_time': 1762891569.710824, 'last_price_update_time': 1764968468.142254}
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KN71804') HTTP/1.1" 204 0
2025-12-05 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN88087> (referer: https://www.auto1.com/v1/car-details-view/YN88087/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK87672> (referer: https://www.auto1.com/v1/car-details-view/RK87672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB33049> (referer: https://www.auto1.com/v1/car-details-view/FB33049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW70915> (referer: https://www.auto1.com/v1/car-details-view/GW70915/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1587c311-b470-5147-ae0e-2b040601e5da with identifier: YN88087
2025-12-05 21:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1587c311-b470-5147-ae0e-2b040601e5da with scrape type 2
2025-12-05 21:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1587c311-b470-5147-ae0e-2b040601e5da with scrape type 2
2025-12-05 21:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1587c311-b470-5147-ae0e-2b040601e5da, identifier: YN88087
2025-12-05 21:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1587c311-b470-5147-ae0e-2b040601e5da with identifier: YN88087
2025-12-05 21:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1587c311-b470-5147-ae0e-2b040601e5da with identifier: YN88087
2025-12-05 21:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1587c311-b470-5147-ae0e-2b040601e5da with identifier: YN88087 to the API
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN88087>
{'auction_title': '',
'c_o_2_emission_value': 70,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 225,
'expiration_date': '2025-12-06T16:33:43Z',
'fuel_type': 'hybrid',
'id': '1587c311-b470-5147-ae0e-2b040601e5da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN88087',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'MINI',
'model': 'Countryman',
'odometer': 129683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper S E Hybrid ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2019}
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN88087%27 HTTP/1.1" 200 None
2025-12-05 21:01:08 [auto1.it] INFO: Saving data for YN88087: {'auction_closing_time': 1765038823.0, 'created_time': 1764878852.366772, 'last_price_update_time': 1764968468.811479}
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN88087') HTTP/1.1" 204 0
2025-12-05 21:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18b5015-d611-5ff5-9579-3e52fc2b9e18 with identifier: RK87672
2025-12-05 21:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18b5015-d611-5ff5-9579-3e52fc2b9e18 with scrape type 2
2025-12-05 21:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a18b5015-d611-5ff5-9579-3e52fc2b9e18 with scrape type 2
2025-12-05 21:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a18b5015-d611-5ff5-9579-3e52fc2b9e18, identifier: RK87672
2025-12-05 21:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b25331b8-e979-5cc7-b704-d9ca52fb4790 with identifier: FB33049
2025-12-05 21:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b25331b8-e979-5cc7-b704-d9ca52fb4790 with scrape type 2
2025-12-05 21:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b25331b8-e979-5cc7-b704-d9ca52fb4790 with scrape type 2
2025-12-05 21:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b25331b8-e979-5cc7-b704-d9ca52fb4790, identifier: FB33049
2025-12-05 21:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54ae981f-d3e8-5f06-9158-6e94d6ab46ce with identifier: GW70915
2025-12-05 21:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54ae981f-d3e8-5f06-9158-6e94d6ab46ce with scrape type 2
2025-12-05 21:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54ae981f-d3e8-5f06-9158-6e94d6ab46ce with scrape type 2
2025-12-05 21:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54ae981f-d3e8-5f06-9158-6e94d6ab46ce, identifier: GW70915
2025-12-05 21:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a18b5015-d611-5ff5-9579-3e52fc2b9e18 with identifier: RK87672
2025-12-05 21:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a18b5015-d611-5ff5-9579-3e52fc2b9e18 with identifier: RK87672
2025-12-05 21:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a18b5015-d611-5ff5-9579-3e52fc2b9e18 with identifier: RK87672 to the API
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK87672>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:27:49Z',
'fuel_type': 'diesel',
'id': 'a18b5015-d611-5ff5-9579-3e52fc2b9e18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK87672',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 131359,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Xcellence',
'transmission': 'manual',
'trim': 'Xcellence',
'year': 2021}
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK87672%27 HTTP/1.1" 200 None
2025-12-05 21:01:09 [auto1.it] INFO: Saving data for RK87672: {'auction_closing_time': 1765038469.0, 'created_time': 1764878569.215859, 'last_price_update_time': 1764968469.418337}
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK87672') HTTP/1.1" 204 0
2025-12-05 21:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b25331b8-e979-5cc7-b704-d9ca52fb4790 with identifier: FB33049
2025-12-05 21:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b25331b8-e979-5cc7-b704-d9ca52fb4790 with identifier: FB33049
2025-12-05 21:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150915 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
150915
2025-12-05 21:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b25331b8-e979-5cc7-b704-d9ca52fb4790 spider: auto1.it
2025-12-05 21:01:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: b25331b8-e979-5cc7-b704-d9ca52fb4790 due to rule: high_mileage_for_country.json, error: 150915 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
150915
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:21:11Z',
'fuel_type': 'diesel',
'id': 'b25331b8-e979-5cc7-b704-d9ca52fb4790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB33049',
'listing': 'auction',
'location': 'IT, Frosinone',
'make': 'Renault',
'model': 'Scenic',
'odometer': 150915,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-15',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB33049%27 HTTP/1.1" 200 None
2025-12-05 21:01:09 [auto1.it] INFO: Saving data for FB33049: {'auction_closing_time': 1765038071.0, 'created_time': 1764878860.096737, 'last_price_update_time': 1764968469.628571}
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB33049') HTTP/1.1" 204 0
2025-12-05 21:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54ae981f-d3e8-5f06-9158-6e94d6ab46ce with identifier: GW70915
2025-12-05 21:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54ae981f-d3e8-5f06-9158-6e94d6ab46ce with identifier: GW70915
2025-12-05 21:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54ae981f-d3e8-5f06-9158-6e94d6ab46ce with identifier: GW70915 to the API
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW70915>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 122,
'expiration_date': '2025-12-06T16:17:43Z',
'fuel_type': 'petrol',
'id': '54ae981f-d3e8-5f06-9158-6e94d6ab46ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW70915',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Mazda',
'model': 'CX-30',
'odometer': 72037,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-30 2.0 Skyactiv-G Mild-Hybrid Executive 2WD',
'transmission': 'manual',
'trim': 'Executive 2WD',
'year': 2021}
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW70915%27 HTTP/1.1" 200 None
2025-12-05 21:01:09 [auto1.it] INFO: Saving data for GW70915: {'auction_closing_time': 1765037863.0, 'created_time': 1764878750.245993, 'last_price_update_time': 1764968469.926772}
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GW70915') HTTP/1.1" 204 0
2025-12-05 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ43419> (referer: https://www.auto1.com/v1/car-details-view/AJ43419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK40358> (referer: https://www.auto1.com/v1/car-details-view/RK40358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE58179> (referer: https://www.auto1.com/v1/car-details-view/NE58179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d95d5c2-e2d2-5031-a65c-8bd521cb6771 with identifier: AJ43419
2025-12-05 21:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d95d5c2-e2d2-5031-a65c-8bd521cb6771 with scrape type 2
2025-12-05 21:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d95d5c2-e2d2-5031-a65c-8bd521cb6771 with scrape type 2
2025-12-05 21:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d95d5c2-e2d2-5031-a65c-8bd521cb6771, identifier: AJ43419
2025-12-05 21:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d1b5c6-96a8-5257-b82a-9c6d04ccaa27 with identifier: RK40358
2025-12-05 21:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d1b5c6-96a8-5257-b82a-9c6d04ccaa27 with scrape type 2
2025-12-05 21:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82d1b5c6-96a8-5257-b82a-9c6d04ccaa27 with scrape type 2
2025-12-05 21:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82d1b5c6-96a8-5257-b82a-9c6d04ccaa27, identifier: RK40358
2025-12-05 21:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc25d2b-e450-5807-8707-41b2bc4708d0 with identifier: NE58179
2025-12-05 21:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc25d2b-e450-5807-8707-41b2bc4708d0 with scrape type 2
2025-12-05 21:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fc25d2b-e450-5807-8707-41b2bc4708d0 with scrape type 2
2025-12-05 21:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1fc25d2b-e450-5807-8707-41b2bc4708d0, identifier: NE58179
2025-12-05 21:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d95d5c2-e2d2-5031-a65c-8bd521cb6771 with identifier: AJ43419
2025-12-05 21:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d95d5c2-e2d2-5031-a65c-8bd521cb6771 with identifier: AJ43419
2025-12-05 21:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d95d5c2-e2d2-5031-a65c-8bd521cb6771 with identifier: AJ43419 to the API
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AJ43419>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 269,
'expiration_date': '2025-12-06T16:29:15Z',
'fuel_type': 'hybrid',
'id': '0d95d5c2-e2d2-5031-a65c-8bd521cb6771',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ43419',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 109417,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque P300e Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2021}
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ43419%27 HTTP/1.1" 200 None
2025-12-05 21:01:10 [auto1.it] INFO: Saving data for AJ43419: {'auction_closing_time': 1765038555.0, 'created_time': 1764237791.952075, 'last_price_update_time': 1764968470.657505}
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ43419') HTTP/1.1" 204 0
2025-12-05 21:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82d1b5c6-96a8-5257-b82a-9c6d04ccaa27 with identifier: RK40358
2025-12-05 21:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82d1b5c6-96a8-5257-b82a-9c6d04ccaa27 with identifier: RK40358
2025-12-05 21:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82d1b5c6-96a8-5257-b82a-9c6d04ccaa27 with identifier: RK40358 to the API
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK40358>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2025-12-06T16:52:50Z',
'fuel_type': 'petrol',
'id': '82d1b5c6-96a8-5257-b82a-9c6d04ccaa27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK40358',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 56352,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Essential',
'transmission': 'manual',
'trim': 'Essential',
'year': 2022}
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK40358%27 HTTP/1.1" 200 None
2025-12-05 21:01:10 [auto1.it] INFO: Saving data for RK40358: {'auction_closing_time': 1765039970.0, 'created_time': 1764878812.01758, 'last_price_update_time': 1764968470.989076}
2025-12-05 21:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK40358') HTTP/1.1" 204 0
2025-12-05 21:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1fc25d2b-e450-5807-8707-41b2bc4708d0 with identifier: NE58179
2025-12-05 21:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1fc25d2b-e450-5807-8707-41b2bc4708d0 with identifier: NE58179
2025-12-05 21:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'infiniti q60 3.0 v6 sport tech awd', 'price': 0, 'currency': 'eur', 'make': 'infiniti', 'model': 'q60', 'transmission': 'automatic', 'odometer': 64122, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne58179', 'expiration_date': '2025-12-06t16:15:47z', 'origin_country_code': 'it', 'trim': 'sport tech awd', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 405, 'doors_number': 2, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '3.0l', 'location': 'it, bentivoglio (bo)', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '1fc25d2b-e450-5807-8707-41b2bc4708d0', 'current_year_diff': 8, 'age_in_months': 103, 'make_model': 'infiniti q60', 'sanitized_make': 'infiniti', 'odometer_in_km': 64122}
Failed validating None in schema:
False
On instance:
{'age_in_months': 103,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 2,
'emission_standard': 'euro 6',
'engine': '3.0l',
'engine_horse_power': 405,
'expiration_date': '2025-12-06t16:15:47z',
'fuel_type': 'petrol',
'id': '1fc25d2b-e450-5807-8707-41b2bc4708d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne58179',
'listing': 'auction',
'location': 'it, bentivoglio (bo)',
'make': 'infiniti',
'make_model': 'infiniti q60',
'model': 'q60',
'odometer': 64122,
'odometer_in_km': 64122,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-02',
'sanitized_make': 'infiniti',
'seats_number': 4,
'seller_name': None,
'title': 'infiniti q60 3.0 v6 sport tech awd',
'transmission': 'automatic',
'trim': 'sport tech awd',
'year': 2017}
2025-12-05 21:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 1fc25d2b-e450-5807-8707-41b2bc4708d0 spider: auto1.it
2025-12-05 21:01:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 1fc25d2b-e450-5807-8707-41b2bc4708d0 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'infiniti q60 3.0 v6 sport tech awd', 'price': 0, 'currency': 'eur', 'make': 'infiniti', 'model': 'q60', 'transmission': 'automatic', 'odometer': 64122, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne58179', 'expiration_date': '2025-12-06t16:15:47z', 'origin_country_code': 'it', 'trim': 'sport tech awd', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 405, 'doors_number': 2, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '3.0l', 'location': 'it, bentivoglio (bo)', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '1fc25d2b-e450-5807-8707-41b2bc4708d0', 'current_year_diff': 8, 'age_in_months': 103, 'make_model': 'infiniti q60', 'sanitized_make': 'infiniti', 'odometer_in_km': 64122}
Failed validating None in schema:
False
On instance:
{'age_in_months': 103,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 2,
'emission_standard': 'euro 6',
'engine': '3.0l',
'engine_horse_power': 405,
'expiration_date': '2025-12-06t16:15:47z',
'fuel_type': 'petrol',
'id': '1fc25d2b-e450-5807-8707-41b2bc4708d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne58179',
'listing': 'auction',
'location': 'it, bentivoglio (bo)',
'make': 'infiniti',
'make_model': 'infiniti q60',
'model': 'q60',
'odometer': 64122,
'odometer_in_km': 64122,
'odometer_reading_unit': 'km',
'origin_country_code': 'it',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-02',
'sanitized_make': 'infiniti',
'seats_number': 4,
'seller_name': None,
'title': 'infiniti q60 3.0 v6 sport tech awd',
'transmission': 'automatic',
'trim': 'sport tech awd',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 405,
'expiration_date': '2025-12-06T16:15:47Z',
'fuel_type': 'petrol',
'id': '1fc25d2b-e450-5807-8707-41b2bc4708d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE58179',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Infiniti',
'model': 'Q60',
'odometer': 64122,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-02',
'seats_number': 4,
'seller_name': None,
'title': 'Infiniti Q60 3.0 V6 Sport Tech AWD',
'transmission': 'automatic',
'trim': 'Sport Tech AWD',
'year': 2017}
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE58179%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Saving data for NE58179: {'auction_closing_time': 1765037747.0, 'created_time': 1764792027.243681, 'last_price_update_time': 1764968471.204092}
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NE58179') HTTP/1.1" 204 0
2025-12-05 21:01:11 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB72839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN76486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN94369> (referer: https://www.auto1.com/v1/car-details-view/EN94369/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN92319> (referer: https://www.auto1.com/v1/car-details-view/EN92319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: FR37481
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR37481%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for FR37481: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: WW34893
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW34893%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for WW34893: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: GU66425
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU66425%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for GU66425: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: YW11574
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW11574%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for YW11574: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: GE44400
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE44400%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for GE44400: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: FS22846
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS22846%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for FS22846: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: KA16351
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA16351%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for KA16351: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: ZZ94683
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ94683%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for ZZ94683: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: JB86723
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB86723%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for JB86723: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: CZ40954
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ40954%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for CZ40954: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: UB92069
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB92069%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for UB92069: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: NY34692
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY34692%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for NY34692: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: DB02360
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB02360%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for DB02360: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: EA06661
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA06661%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for EA06661: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: LX99964
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX99964%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for LX99964: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: ZP66888
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66888%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for ZP66888: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: DU65956
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU65956%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for DU65956: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: TZ58430
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ58430%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for TZ58430: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: HP11759
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP11759%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for HP11759: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: ZH40946
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH40946%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for ZH40946: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: UT73066
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT73066%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for UT73066: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: GV64817
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV64817%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for GV64817: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: BP08854
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08854%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for BP08854: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: HC13600
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC13600%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for HC13600: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: HF33794
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF33794%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for HF33794: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: EM38721
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM38721%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for EM38721: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: DK85340
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK85340%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for DK85340: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: SD77820
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD77820%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for SD77820: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: XF76869
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF76869%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for XF76869: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: SK30894
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK30894%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for SK30894: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: FF57378
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF57378%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for FF57378: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: WF17788
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF17788%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for WF17788: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: DJ04394
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ04394%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for DJ04394: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: EP34580
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP34580%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for EP34580: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: HK45247
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK45247%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for HK45247: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: EV82376
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV82376%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for EV82376: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: FL04510
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL04510%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for FL04510: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: PC65612
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC65612%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for PC65612: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: TD15541
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD15541%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for TD15541: 0
2025-12-05 21:01:11 [auto1.it] INFO: Found listing with ID: BL08062
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL08062%27 HTTP/1.1" 200 None
2025-12-05 21:01:11 [auto1.it] INFO: Scrape type for BL08062: 0
2025-12-05 21:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2206956-4735-5f93-819e-a2e9d76d9a0c with identifier: EN94369
2025-12-05 21:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2206956-4735-5f93-819e-a2e9d76d9a0c with scrape type 2
2025-12-05 21:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2206956-4735-5f93-819e-a2e9d76d9a0c with scrape type 2
2025-12-05 21:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2206956-4735-5f93-819e-a2e9d76d9a0c, identifier: EN94369
2025-12-05 21:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d3293a-8338-56a3-8629-435d8d81b884 with identifier: EN92319
2025-12-05 21:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d3293a-8338-56a3-8629-435d8d81b884 with scrape type 2
2025-12-05 21:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1d3293a-8338-56a3-8629-435d8d81b884 with scrape type 2
2025-12-05 21:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d1d3293a-8338-56a3-8629-435d8d81b884, identifier: EN92319
2025-12-05 21:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2206956-4735-5f93-819e-a2e9d76d9a0c with identifier: EN94369
2025-12-05 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2206956-4735-5f93-819e-a2e9d76d9a0c with identifier: EN94369
2025-12-05 21:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2206956-4735-5f93-819e-a2e9d76d9a0c with identifier: EN94369 to the API
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN94369>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2025-12-06T16:24:31Z',
'fuel_type': 'petrol',
'id': 'b2206956-4735-5f93-819e-a2e9d76d9a0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN94369',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 15305,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-26',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Trendy',
'transmission': 'automatic',
'trim': 'Trendy',
'year': 2022}
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN94369%27 HTTP/1.1" 200 None
2025-12-05 21:01:12 [auto1.it] INFO: Saving data for EN94369: {'auction_closing_time': 1765038271.0, 'created_time': 1764878808.203746, 'last_price_update_time': 1764968472.410871}
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN94369') HTTP/1.1" 204 0
2025-12-05 21:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d1d3293a-8338-56a3-8629-435d8d81b884 with identifier: EN92319
2025-12-05 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d1d3293a-8338-56a3-8629-435d8d81b884 with identifier: EN92319
2025-12-05 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189594 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
189594
2025-12-05 21:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d1d3293a-8338-56a3-8629-435d8d81b884 spider: auto1.it
2025-12-05 21:01:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d1d3293a-8338-56a3-8629-435d8d81b884 due to rule: high_mileage_for_country.json, error: 189594 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
189594
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:59:17Z',
'fuel_type': 'diesel',
'id': 'd1d3293a-8338-56a3-8629-435d8d81b884',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN92319',
'listing': 'auction',
'location': 'Lecco',
'make': 'BMW',
'model': '5er',
'odometer': 189594,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 520d xDrive Luxury Line',
'transmission': 'automatic',
'trim': 'xDrive Luxury Line',
'year': 2018}
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN92319%27 HTTP/1.1" 200 None
2025-12-05 21:01:12 [auto1.it] INFO: Saving data for EN92319: {'auction_closing_time': 1765040357.0, 'created_time': 1764878737.156716, 'last_price_update_time': 1764968472.721775}
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN92319') HTTP/1.1" 204 0
2025-12-05 21:01:12 [scrapy.extensions.logstats] INFO: Crawled 171 pages (at 171 pages/min), scraped 52 items (at 52 items/min)
2025-12-05 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY94975> (referer: https://www.auto1.com/v1/car-details-view/TY94975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD09667> (referer: https://www.auto1.com/v1/car-details-view/XD09667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT35783> (referer: https://www.auto1.com/v1/car-details-view/MT35783/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG07242> (referer: https://www.auto1.com/v1/car-details-view/LG07242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f99d3bd3-076c-5cd6-8cd9-ad28dd730c18 with identifier: TY94975
2025-12-05 21:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f99d3bd3-076c-5cd6-8cd9-ad28dd730c18 with scrape type 2
2025-12-05 21:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f99d3bd3-076c-5cd6-8cd9-ad28dd730c18 with scrape type 2
2025-12-05 21:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f99d3bd3-076c-5cd6-8cd9-ad28dd730c18, identifier: TY94975
2025-12-05 21:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3b4f7be-b652-5504-913d-181ba109fb81 with identifier: XD09667
2025-12-05 21:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3b4f7be-b652-5504-913d-181ba109fb81 with scrape type 2
2025-12-05 21:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3b4f7be-b652-5504-913d-181ba109fb81 with scrape type 2
2025-12-05 21:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3b4f7be-b652-5504-913d-181ba109fb81, identifier: XD09667
2025-12-05 21:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f99d3bd3-076c-5cd6-8cd9-ad28dd730c18 with identifier: TY94975
2025-12-05 21:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f99d3bd3-076c-5cd6-8cd9-ad28dd730c18 with identifier: TY94975
2025-12-05 21:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f99d3bd3-076c-5cd6-8cd9-ad28dd730c18 with identifier: TY94975 to the API
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY94975>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:52:06Z',
'fuel_type': 'petrol',
'id': 'f99d3bd3-076c-5cd6-8cd9-ad28dd730c18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY94975',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 20618,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY94975%27 HTTP/1.1" 200 None
2025-12-05 21:01:13 [auto1.it] INFO: Saving data for TY94975: {'auction_closing_time': 1765039926.0, 'created_time': 1764878858.706096, 'last_price_update_time': 1764968473.318948}
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TY94975') HTTP/1.1" 204 0
2025-12-05 21:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3b4f7be-b652-5504-913d-181ba109fb81 with identifier: XD09667
2025-12-05 21:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3b4f7be-b652-5504-913d-181ba109fb81 with identifier: XD09667
2025-12-05 21:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3b4f7be-b652-5504-913d-181ba109fb81 with identifier: XD09667 to the API
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD09667>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2025-12-06T16:50:05Z',
'fuel_type': 'petrol',
'id': 'c3b4f7be-b652-5504-913d-181ba109fb81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD09667',
'listing': 'auction',
'location': 'IT, Corsico',
'make': 'Citroen',
'model': 'C1',
'odometer': 66612,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0 VTi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2021}
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD09667%27 HTTP/1.1" 200 None
2025-12-05 21:01:13 [auto1.it] INFO: Saving data for XD09667: {'auction_closing_time': 1765039805.0, 'created_time': 1764878608.481622, 'last_price_update_time': 1764968473.633357}
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XD09667') HTTP/1.1" 204 0
2025-12-05 21:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b1010db-0d91-57f9-987f-9caaa20f4007 with identifier: MT35783
2025-12-05 21:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b1010db-0d91-57f9-987f-9caaa20f4007 with scrape type 2
2025-12-05 21:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b1010db-0d91-57f9-987f-9caaa20f4007 with scrape type 2
2025-12-05 21:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b1010db-0d91-57f9-987f-9caaa20f4007, identifier: MT35783
2025-12-05 21:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b1010db-0d91-57f9-987f-9caaa20f4007 with identifier: MT35783
2025-12-05 21:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b1010db-0d91-57f9-987f-9caaa20f4007 with identifier: MT35783
2025-12-05 21:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b1010db-0d91-57f9-987f-9caaa20f4007 with identifier: MT35783 to the API
2025-12-05 21:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MT35783>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:35:10Z',
'fuel_type': 'petrol',
'id': '8b1010db-0d91-57f9-987f-9caaa20f4007',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT35783',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 105959,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35783%27 HTTP/1.1" 200 None
2025-12-05 21:01:14 [auto1.it] INFO: Saving data for MT35783: {'auction_closing_time': 1765038910.0, 'created_time': 1764878618.995336, 'last_price_update_time': 1764968474.139531}
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT35783') HTTP/1.1" 204 0
2025-12-05 21:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242
2025-12-05 21:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614fbb5e-6d91-58e6-a433-14a9df641eb1 with scrape type 2
2025-12-05 21:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 614fbb5e-6d91-58e6-a433-14a9df641eb1 with scrape type 2
2025-12-05 21:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 614fbb5e-6d91-58e6-a433-14a9df641eb1, identifier: LG07242
2025-12-05 21:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242
2025-12-05 21:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242
2025-12-05 21:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242 to the API
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG07242>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:21:45Z',
'fuel_type': 'petrol',
'id': '614fbb5e-6d91-58e6-a433-14a9df641eb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG07242',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Ford',
'model': 'Kuga',
'odometer': 88526,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2018}
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2025-12-05 21:01:14 [auto1.it] INFO: Saving data for LG07242: {'auction_closing_time': 1765038105.0, 'created_time': 1764878744.344553, 'last_price_update_time': 1764968474.598833}
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG07242') HTTP/1.1" 204 0
2025-12-05 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ98323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL52920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT66786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD19980> (referer: https://www.auto1.com/v1/car-details-view/JD19980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c8d86d-550b-59b0-a472-fc7cccc01fae with identifier: JD19980
2025-12-05 21:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c8d86d-550b-59b0-a472-fc7cccc01fae with scrape type 2
2025-12-05 21:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c8d86d-550b-59b0-a472-fc7cccc01fae with scrape type 2
2025-12-05 21:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4c8d86d-550b-59b0-a472-fc7cccc01fae, identifier: JD19980
2025-12-05 21:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4c8d86d-550b-59b0-a472-fc7cccc01fae with identifier: JD19980
2025-12-05 21:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4c8d86d-550b-59b0-a472-fc7cccc01fae with identifier: JD19980
2025-12-05 21:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4c8d86d-550b-59b0-a472-fc7cccc01fae with identifier: JD19980 to the API
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JD19980>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2025-12-06T16:34:27Z',
'fuel_type': 'diesel',
'id': 'a4c8d86d-550b-59b0-a472-fc7cccc01fae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD19980',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Nissan',
'model': 'Micra',
'odometer': 146648,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Micra 1.5 dCi Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2018}
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD19980%27 HTTP/1.1" 200 None
2025-12-05 21:01:15 [auto1.it] INFO: Saving data for JD19980: {'auction_closing_time': 1765038867.0, 'created_time': 1764878785.247124, 'last_price_update_time': 1764968475.291572}
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JD19980') HTTP/1.1" 204 0
2025-12-05 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH52637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN77058> (referer: https://www.auto1.com/v1/car-details-view/FN77058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB71974> (referer: https://www.auto1.com/v1/car-details-view/CB71974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ64789> (referer: https://www.auto1.com/v1/car-details-view/PZ64789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058
2025-12-05 21:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with scrape type 2
2025-12-05 21:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with scrape type 2
2025-12-05 21:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66, identifier: FN77058
2025-12-05 21:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058
2025-12-05 21:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058
2025-12-05 21:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058 to the API
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN77058>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:18:42Z',
'fuel_type': 'diesel',
'id': 'b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN77058',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Audi',
'model': 'Q3',
'odometer': 114111,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN77058%27 HTTP/1.1" 200 None
2025-12-05 21:01:15 [auto1.it] INFO: Saving data for FN77058: {'auction_closing_time': 1765037922.0, 'created_time': 1764878586.035167, 'last_price_update_time': 1764968475.798404}
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN77058') HTTP/1.1" 204 0
2025-12-05 21:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8904a8-7700-5760-a17c-82eb24ba11f7 with identifier: CB71974
2025-12-05 21:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8904a8-7700-5760-a17c-82eb24ba11f7 with scrape type 2
2025-12-05 21:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8904a8-7700-5760-a17c-82eb24ba11f7 with scrape type 2
2025-12-05 21:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e8904a8-7700-5760-a17c-82eb24ba11f7, identifier: CB71974
2025-12-05 21:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b032e92-fb35-5aa9-896d-988fff2c4ebb with identifier: PZ64789
2025-12-05 21:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b032e92-fb35-5aa9-896d-988fff2c4ebb with scrape type 2
2025-12-05 21:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b032e92-fb35-5aa9-896d-988fff2c4ebb with scrape type 2
2025-12-05 21:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b032e92-fb35-5aa9-896d-988fff2c4ebb, identifier: PZ64789
2025-12-05 21:01:16 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e8904a8-7700-5760-a17c-82eb24ba11f7 with identifier: CB71974
2025-12-05 21:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e8904a8-7700-5760-a17c-82eb24ba11f7 with identifier: CB71974
2025-12-05 21:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172767 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172767
2025-12-05 21:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4e8904a8-7700-5760-a17c-82eb24ba11f7 spider: auto1.it
2025-12-05 21:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4e8904a8-7700-5760-a17c-82eb24ba11f7 due to rule: high_mileage_for_country.json, error: 172767 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172767
{'auction_title': '',
'c_o_2_emission_value': 181,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2025-12-06T16:51:58Z',
'fuel_type': 'diesel',
'id': '4e8904a8-7700-5760-a17c-82eb24ba11f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB71974',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 172767,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque D200 Mild-Hybrid Autobiography',
'transmission': 'automatic',
'trim': 'Autobiography',
'year': 2021}
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB71974%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Saving data for CB71974: {'auction_closing_time': 1765039918.0, 'created_time': 1762545913.117693, 'last_price_update_time': 1764968476.19753}
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB71974') HTTP/1.1" 204 0
2025-12-05 21:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b032e92-fb35-5aa9-896d-988fff2c4ebb with identifier: PZ64789
2025-12-05 21:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b032e92-fb35-5aa9-896d-988fff2c4ebb with identifier: PZ64789
2025-12-05 21:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 21:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0b032e92-fb35-5aa9-896d-988fff2c4ebb spider: auto1.it
2025-12-05 21:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0b032e92-fb35-5aa9-896d-988fff2c4ebb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:29:18Z',
'fuel_type': 'diesel',
'id': '0b032e92-fb35-5aa9-896d-988fff2c4ebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ64789',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 117109,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi XTR',
'transmission': 'manual',
'trim': 'XTR',
'year': 2018}
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ64789%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Saving data for PZ64789: {'auction_closing_time': 1765038558.0, 'created_time': 1764792340.69848, 'last_price_update_time': 1764968476.412649}
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ64789') HTTP/1.1" 204 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: SM97428
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM97428%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for SM97428: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: RC08182
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC08182%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for RC08182: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: LB50732
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50732%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for LB50732: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: NX36861
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX36861%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for NX36861: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: MV75173
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV75173%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for MV75173: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: XT46123
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT46123%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for XT46123: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: LU15302
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU15302%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for LU15302: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: EE73426
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE73426%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for EE73426: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: BZ10581
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ10581%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for BZ10581: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: FB36220
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB36220%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for FB36220: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: HS63299
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS63299%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for HS63299: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: TM70777
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM70777%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for TM70777: 2
2025-12-05 21:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ38175> (referer: https://www.auto1.com/v1/car-details-view/GZ38175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: AL85542
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL85542%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for AL85542: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: BE58033
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE58033%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for BE58033: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: UF60183
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF60183%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for UF60183: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: FN81119
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81119%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for FN81119: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: SS94947
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for SS94947: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: JP94676
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP94676%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for JP94676: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: NT07834
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT07834%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for NT07834: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: TK25750
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK25750%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for TK25750: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: KG59553
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG59553%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for KG59553: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: MP56033
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP56033%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for MP56033: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: GA79418
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA79418%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for GA79418: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: AV22588
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV22588%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for AV22588: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: JA93014
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA93014%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for JA93014: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: BB48668
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB48668%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for BB48668: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: LA46631
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA46631%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for LA46631: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: JB16740
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB16740%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for JB16740: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: PJ96401
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ96401%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for PJ96401: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: HW99743
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99743%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for HW99743: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: BG39549
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG39549%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for BG39549: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: EL99717
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL99717%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for EL99717: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: MJ70755
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ70755%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for MJ70755: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: TY92784
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY92784%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for TY92784: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: SA26868
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA26868%27 HTTP/1.1" 200 None
2025-12-05 21:01:16 [auto1.it] INFO: Scrape type for SA26868: 0
2025-12-05 21:01:16 [auto1.it] INFO: Found listing with ID: VP46319
2025-12-05 21:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP46319%27 HTTP/1.1" 200 None
2025-12-05 21:01:17 [auto1.it] INFO: Scrape type for VP46319: 0
2025-12-05 21:01:17 [auto1.it] INFO: Found listing with ID: GT71409
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT71409%27 HTTP/1.1" 200 None
2025-12-05 21:01:17 [auto1.it] INFO: Scrape type for GT71409: 0
2025-12-05 21:01:17 [auto1.it] INFO: Found listing with ID: UP67985
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP67985%27 HTTP/1.1" 200 None
2025-12-05 21:01:17 [auto1.it] INFO: Scrape type for UP67985: 0
2025-12-05 21:01:17 [auto1.it] INFO: Found listing with ID: PW70541
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70541%27 HTTP/1.1" 200 None
2025-12-05 21:01:17 [auto1.it] INFO: Scrape type for PW70541: 0
2025-12-05 21:01:17 [auto1.it] INFO: Found listing with ID: FK02504
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK02504%27 HTTP/1.1" 200 None
2025-12-05 21:01:17 [auto1.it] INFO: Scrape type for FK02504: 0
2025-12-05 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX83454> (referer: https://www.auto1.com/v1/car-details-view/HX83454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM12647> (referer: https://www.auto1.com/v1/car-details-view/LM12647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1 with identifier: GZ38175
2025-12-05 21:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1 with scrape type 2
2025-12-05 21:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1 with scrape type 2
2025-12-05 21:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1, identifier: GZ38175
2025-12-05 21:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1 with identifier: GZ38175
2025-12-05 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1 with identifier: GZ38175
2025-12-05 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159884 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159884
2025-12-05 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1 spider: auto1.it
2025-12-05 21:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 9e5021a8-f2b6-50b3-a601-f6f8c8b766a1 due to rule: high_mileage_for_country.json, error: 159884 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
159884
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:42:28Z',
'fuel_type': 'diesel',
'id': '9e5021a8-f2b6-50b3-a601-f6f8c8b766a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ38175',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 159884,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-03',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Tipo 1.3 M-Jet Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ38175%27 HTTP/1.1" 200 None
2025-12-05 21:01:17 [auto1.it] INFO: Saving data for GZ38175: {'auction_closing_time': 1765039348.0, 'created_time': 1764878622.475271, 'last_price_update_time': 1764968477.43972}
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ38175') HTTP/1.1" 204 0
2025-12-05 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC40670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB72839> (referer: https://www.auto1.com/v1/car-details-view/AB72839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL52920> (referer: https://www.auto1.com/v1/car-details-view/AL52920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ98323> (referer: https://www.auto1.com/v1/car-details-view/FJ98323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN76486> (referer: https://www.auto1.com/v1/car-details-view/HN76486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad862e0d-8d4f-5110-a3bb-ff0e0137bad5 with identifier: HX83454
2025-12-05 21:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad862e0d-8d4f-5110-a3bb-ff0e0137bad5 with scrape type 2
2025-12-05 21:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad862e0d-8d4f-5110-a3bb-ff0e0137bad5 with scrape type 2
2025-12-05 21:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad862e0d-8d4f-5110-a3bb-ff0e0137bad5, identifier: HX83454
2025-12-05 21:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647
2025-12-05 21:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34da1ce6-770f-5d46-a202-90f23a20a744 with scrape type 2
2025-12-05 21:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34da1ce6-770f-5d46-a202-90f23a20a744 with scrape type 2
2025-12-05 21:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34da1ce6-770f-5d46-a202-90f23a20a744, identifier: LM12647
2025-12-05 21:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad862e0d-8d4f-5110-a3bb-ff0e0137bad5 with identifier: HX83454
2025-12-05 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad862e0d-8d4f-5110-a3bb-ff0e0137bad5 with identifier: HX83454
2025-12-05 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2025-12-05 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ad862e0d-8d4f-5110-a3bb-ff0e0137bad5 spider: auto1.it
2025-12-05 21:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ad862e0d-8d4f-5110-a3bb-ff0e0137bad5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 100,
'expiration_date': '2025-12-06T16:10:12Z',
'fuel_type': 'petrol',
'id': 'ad862e0d-8d4f-5110-a3bb-ff0e0137bad5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX83454',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Ford',
'model': 'Transit',
'odometer': 11325,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-01-22',
'seats_number': 2,
'seller_name': None,
'title': 'Ford Transit 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2024}
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX83454%27 HTTP/1.1" 200 None
2025-12-05 21:01:17 [auto1.it] INFO: Saving data for HX83454: {'auction_closing_time': 1765037412.0, 'created_time': 1764878568.175957, 'last_price_update_time': 1764968477.944193}
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HX83454') HTTP/1.1" 204 0
2025-12-05 21:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647
2025-12-05 21:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647
2025-12-05 21:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647 to the API
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LM12647>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:36:20Z',
'fuel_type': 'diesel',
'id': '34da1ce6-770f-5d46-a202-90f23a20a744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM12647',
'listing': 'auction',
'location': 'IT, Como',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 101480,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
'transmission': 'automatic',
'trim': 'Q4 Business',
'year': 2019}
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2025-12-05 21:01:18 [auto1.it] INFO: Saving data for LM12647: {'auction_closing_time': 1765038980.0, 'created_time': 1764878833.095708, 'last_price_update_time': 1764968478.247366}
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM12647') HTTP/1.1" 204 0
2025-12-05 21:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2064d530-91e7-5efd-8430-32d49ec8759f with identifier: AB72839
2025-12-05 21:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2064d530-91e7-5efd-8430-32d49ec8759f with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2064d530-91e7-5efd-8430-32d49ec8759f with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2064d530-91e7-5efd-8430-32d49ec8759f, identifier: AB72839
2025-12-05 21:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22809ad1-6dae-52f4-ba2b-f7deeea4db11 with identifier: AL52920
2025-12-05 21:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22809ad1-6dae-52f4-ba2b-f7deeea4db11 with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22809ad1-6dae-52f4-ba2b-f7deeea4db11 with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22809ad1-6dae-52f4-ba2b-f7deeea4db11, identifier: AL52920
2025-12-05 21:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af633ed8-1631-5b98-948a-4664f82a7026 with identifier: FJ98323
2025-12-05 21:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af633ed8-1631-5b98-948a-4664f82a7026 with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af633ed8-1631-5b98-948a-4664f82a7026 with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af633ed8-1631-5b98-948a-4664f82a7026, identifier: FJ98323
2025-12-05 21:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7771c4cb-19aa-5584-90ad-a0358dd54342 with identifier: HN76486
2025-12-05 21:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7771c4cb-19aa-5584-90ad-a0358dd54342 with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7771c4cb-19aa-5584-90ad-a0358dd54342 with scrape type 2
2025-12-05 21:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7771c4cb-19aa-5584-90ad-a0358dd54342, identifier: HN76486
2025-12-05 21:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2064d530-91e7-5efd-8430-32d49ec8759f with identifier: AB72839
2025-12-05 21:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2064d530-91e7-5efd-8430-32d49ec8759f with identifier: AB72839
2025-12-05 21:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2064d530-91e7-5efd-8430-32d49ec8759f with identifier: AB72839 to the API
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB72839>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:12:18Z',
'fuel_type': 'diesel',
'id': '2064d530-91e7-5efd-8430-32d49ec8759f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB72839',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 90428,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-09',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2022}
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB72839%27 HTTP/1.1" 200 None
2025-12-05 21:01:18 [auto1.it] INFO: Saving data for AB72839: {'auction_closing_time': 1765037538.0, 'created_time': 1764878583.261753, 'last_price_update_time': 1764968478.948082}
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB72839') HTTP/1.1" 204 0
2025-12-05 21:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22809ad1-6dae-52f4-ba2b-f7deeea4db11 with identifier: AL52920
2025-12-05 21:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22809ad1-6dae-52f4-ba2b-f7deeea4db11 with identifier: AL52920
2025-12-05 21:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22809ad1-6dae-52f4-ba2b-f7deeea4db11 with identifier: AL52920 to the API
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL52920>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:37:10Z',
'fuel_type': 'diesel',
'id': '22809ad1-6dae-52f4-ba2b-f7deeea4db11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL52920',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Seat',
'model': 'Arona',
'odometer': 79034,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL52920%27 HTTP/1.1" 200 None
2025-12-05 21:01:19 [auto1.it] INFO: Saving data for AL52920: {'auction_closing_time': 1765039030.0, 'created_time': 1764878785.699809, 'last_price_update_time': 1764968479.258534}
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL52920') HTTP/1.1" 204 0
2025-12-05 21:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af633ed8-1631-5b98-948a-4664f82a7026 with identifier: FJ98323
2025-12-05 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af633ed8-1631-5b98-948a-4664f82a7026 with identifier: FJ98323
2025-12-05 21:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af633ed8-1631-5b98-948a-4664f82a7026 with identifier: FJ98323 to the API
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ98323>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 80,
'expiration_date': '2025-12-06T16:52:17Z',
'fuel_type': 'petrol',
'id': 'af633ed8-1631-5b98-948a-4664f82a7026',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ98323',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 67037,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-21',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ98323%27 HTTP/1.1" 200 None
2025-12-05 21:01:19 [auto1.it] INFO: Saving data for FJ98323: {'auction_closing_time': 1765039937.0, 'created_time': 1762372939.821132, 'last_price_update_time': 1764968479.570893}
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ98323') HTTP/1.1" 204 0
2025-12-05 21:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7771c4cb-19aa-5584-90ad-a0358dd54342 with identifier: HN76486
2025-12-05 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7771c4cb-19aa-5584-90ad-a0358dd54342 with identifier: HN76486
2025-12-05 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151068 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151068
2025-12-05 21:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7771c4cb-19aa-5584-90ad-a0358dd54342 spider: auto1.it
2025-12-05 21:01:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 7771c4cb-19aa-5584-90ad-a0358dd54342 due to rule: high_mileage_for_country.json, error: 151068 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151068
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:15:17Z',
'fuel_type': 'petrol',
'id': '7771c4cb-19aa-5584-90ad-a0358dd54342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN76486',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Skoda',
'model': 'Superb',
'odometer': 151068,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Superb 1.5 TSI ACT Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2018}
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN76486%27 HTTP/1.1" 200 None
2025-12-05 21:01:19 [auto1.it] INFO: Saving data for HN76486: {'auction_closing_time': 1765037717.0, 'created_time': 1764878677.197123, 'last_price_update_time': 1764968479.769432}
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HN76486') HTTP/1.1" 204 0
2025-12-05 21:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH52637> (referer: https://www.auto1.com/v1/car-details-view/TH52637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT66786> (referer: https://www.auto1.com/v1/car-details-view/RT66786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7086cf-2c0c-57b2-af6b-1d64a453c167 with identifier: TH52637
2025-12-05 21:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7086cf-2c0c-57b2-af6b-1d64a453c167 with scrape type 2
2025-12-05 21:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7086cf-2c0c-57b2-af6b-1d64a453c167 with scrape type 2
2025-12-05 21:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd7086cf-2c0c-57b2-af6b-1d64a453c167, identifier: TH52637
2025-12-05 21:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce95b0e-c611-5560-b26a-62937baee17b with identifier: RT66786
2025-12-05 21:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce95b0e-c611-5560-b26a-62937baee17b with scrape type 2
2025-12-05 21:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ce95b0e-c611-5560-b26a-62937baee17b with scrape type 2
2025-12-05 21:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ce95b0e-c611-5560-b26a-62937baee17b, identifier: RT66786
2025-12-05 21:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd7086cf-2c0c-57b2-af6b-1d64a453c167 with identifier: TH52637
2025-12-05 21:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd7086cf-2c0c-57b2-af6b-1d64a453c167 with identifier: TH52637
2025-12-05 21:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd7086cf-2c0c-57b2-af6b-1d64a453c167 with identifier: TH52637 to the API
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH52637>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 286,
'expiration_date': '2025-12-06T16:47:04Z',
'fuel_type': 'diesel',
'id': 'fd7086cf-2c0c-57b2-af6b-1d64a453c167',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH52637',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 112960,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-04',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 d Mild-Hybrid T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2022}
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH52637%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Saving data for TH52637: {'auction_closing_time': 1765039624.0, 'created_time': 1764878581.650456, 'last_price_update_time': 1764968480.384253}
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH52637') HTTP/1.1" 204 0
2025-12-05 21:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ce95b0e-c611-5560-b26a-62937baee17b with identifier: RT66786
2025-12-05 21:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ce95b0e-c611-5560-b26a-62937baee17b with identifier: RT66786
2025-12-05 21:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ce95b0e-c611-5560-b26a-62937baee17b with identifier: RT66786 to the API
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT66786>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:18:21Z',
'fuel_type': 'petrol',
'id': '7ce95b0e-c611-5560-b26a-62937baee17b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT66786',
'listing': 'auction',
'location': 'Varese',
'make': 'Peugeot',
'model': '208',
'odometer': 115293,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2021}
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT66786%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Saving data for RT66786: {'auction_closing_time': 1765037901.0, 'created_time': 1764878670.520913, 'last_price_update_time': 1764968480.670682}
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT66786') HTTP/1.1" 204 0
2025-12-05 21:01:20 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM70777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: DP28978
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP28978%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for DP28978: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: BM29005
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM29005%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for BM29005: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: JX72433
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX72433%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for JX72433: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: HF58868
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF58868%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for HF58868: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: VC15386
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC15386%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for VC15386: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: GF05502
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05502%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for GF05502: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: KC69548
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC69548%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for KC69548: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: EL05291
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for EL05291: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: FJ86916
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ86916%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for FJ86916: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: EC73786
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC73786%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for EC73786: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: HM78467
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM78467%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for HM78467: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: XU79981
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU79981%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for XU79981: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: YH15526
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH15526%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for YH15526: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: ET69772
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET69772%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for ET69772: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: KR69258
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR69258%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for KR69258: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: SH57663
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH57663%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for SH57663: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: ZZ38543
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ38543%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for ZZ38543: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: JS87755
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for JS87755: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: TR70280
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR70280%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for TR70280: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: HB67400
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB67400%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for HB67400: 0
2025-12-05 21:01:20 [auto1.it] INFO: Found listing with ID: BX65546
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX65546%27 HTTP/1.1" 200 None
2025-12-05 21:01:20 [auto1.it] INFO: Scrape type for BX65546: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: NH86693
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH86693%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for NH86693: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: FD37849
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD37849%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for FD37849: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: CE82522
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE82522%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for CE82522: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: KT64449
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64449%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for KT64449: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: LU74910
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU74910%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for LU74910: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: BL82324
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL82324%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for BL82324: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: CB32763
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB32763%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for CB32763: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: LY90448
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY90448%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for LY90448: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: CW68051
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW68051%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for CW68051: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: ZC12313
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC12313%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for ZC12313: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: KC62935
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC62935%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for KC62935: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: DF14227
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF14227%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for DF14227: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: YB92663
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for YB92663: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: AU30700
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU30700%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for AU30700: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: WJ53867
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ53867%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for WJ53867: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: US74499
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US74499%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for US74499: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: JW97025
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW97025%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for JW97025: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: JA20233
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA20233%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for JA20233: 0
2025-12-05 21:01:21 [auto1.it] INFO: Found listing with ID: LM82104
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM82104%27 HTTP/1.1" 200 None
2025-12-05 21:01:21 [auto1.it] INFO: Scrape type for LM82104: 0
2025-12-05 21:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC40670> (referer: https://www.auto1.com/v1/car-details-view/WC40670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:22 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: ZD81765
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD81765%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for ZD81765: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: SR31732
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR31732%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for SR31732: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: NY39910
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY39910%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for NY39910: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: LX50050
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX50050%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for LX50050: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: WG22278
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for WG22278: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: RG34096
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG34096%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for RG34096: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: GB75182
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB75182%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for GB75182: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: HK56128
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK56128%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for HK56128: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: ZF25118
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF25118%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for ZF25118: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: SW58220
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW58220%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for SW58220: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: GY23026
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY23026%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for GY23026: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: PM40401
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM40401%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for PM40401: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: NR27447
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR27447%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for NR27447: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: HK99517
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK99517%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for HK99517: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: BM83226
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM83226%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for BM83226: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: ZD64809
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD64809%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for ZD64809: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: NS14568
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS14568%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for NS14568: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: PR20498
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR20498%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for PR20498: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: CE05894
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE05894%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for CE05894: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: AB82750
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB82750%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for AB82750: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: MD13712
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD13712%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for MD13712: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: FJ06005
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ06005%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for FJ06005: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: LH16406
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH16406%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for LH16406: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: VE23959
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23959%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for VE23959: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: CA12776
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA12776%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for CA12776: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: CP36603
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP36603%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for CP36603: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: TU05159
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU05159%27 HTTP/1.1" 200 None
2025-12-05 21:01:22 [auto1.it] INFO: Scrape type for TU05159: 0
2025-12-05 21:01:22 [auto1.it] INFO: Found listing with ID: JU85214
2025-12-05 21:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU85214%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for JU85214: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: TC56605
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC56605%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for TC56605: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: RE49943
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49943%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for RE49943: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: XV69031
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV69031%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for XV69031: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: GL72110
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL72110%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for GL72110: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: GW22031
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW22031%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for GW22031: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: CA23439
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA23439%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for CA23439: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: YZ75432
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ75432%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for YZ75432: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: CZ56358
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ56358%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for CZ56358: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: AF54996
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF54996%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for AF54996: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: AX48769
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX48769%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for AX48769: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: WP71679
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP71679%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for WP71679: 0
2025-12-05 21:01:23 [auto1.it] INFO: Found listing with ID: HS25644
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS25644%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Scrape type for HS25644: 0
2025-12-05 21:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM70777> (referer: https://www.auto1.com/v1/car-details-view/TM70777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0efc4ca-1382-55a6-bcf5-0fb163f23915 with identifier: WC40670
2025-12-05 21:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0efc4ca-1382-55a6-bcf5-0fb163f23915 with scrape type 2
2025-12-05 21:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0efc4ca-1382-55a6-bcf5-0fb163f23915 with scrape type 2
2025-12-05 21:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0efc4ca-1382-55a6-bcf5-0fb163f23915, identifier: WC40670
2025-12-05 21:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0efc4ca-1382-55a6-bcf5-0fb163f23915 with identifier: WC40670
2025-12-05 21:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0efc4ca-1382-55a6-bcf5-0fb163f23915 with identifier: WC40670
2025-12-05 21:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0efc4ca-1382-55a6-bcf5-0fb163f23915 with identifier: WC40670 to the API
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC40670>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:55:37Z',
'fuel_type': 'diesel',
'id': 'c0efc4ca-1382-55a6-bcf5-0fb163f23915',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC40670',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 92610,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-25',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2019}
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC40670%27 HTTP/1.1" 200 None
2025-12-05 21:01:23 [auto1.it] INFO: Saving data for WC40670: {'auction_closing_time': 1765040137.0, 'created_time': 1764792223.251386, 'last_price_update_time': 1764968483.841794}
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC40670') HTTP/1.1" 204 0
2025-12-05 21:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47563734-d70e-5bf4-b481-4bc72cffc5b2 with identifier: TM70777
2025-12-05 21:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47563734-d70e-5bf4-b481-4bc72cffc5b2 with scrape type 2
2025-12-05 21:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47563734-d70e-5bf4-b481-4bc72cffc5b2 with scrape type 2
2025-12-05 21:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47563734-d70e-5bf4-b481-4bc72cffc5b2, identifier: TM70777
2025-12-05 21:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47563734-d70e-5bf4-b481-4bc72cffc5b2 with identifier: TM70777
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2025-12-05 21:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 21:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47563734-d70e-5bf4-b481-4bc72cffc5b2 with identifier: TM70777
2025-12-05 21:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47563734-d70e-5bf4-b481-4bc72cffc5b2 with identifier: TM70777 to the API
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 21:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TM70777>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 299,
'expiration_date': '2025-12-06T16:10:00Z',
'fuel_type': 'electro',
'id': '47563734-d70e-5bf4-b481-4bc72cffc5b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM70777',
'listing': 'auction',
'location': 'Napoli',
'make': 'Tesla',
'model': 'Model Y',
'odometer': 11557,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-10',
'seats_number': 5,
'seller_name': None,
'title': 'Tesla Model Y Standard Range',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM70777%27 HTTP/1.1" 200 None
2025-12-05 21:01:24 [auto1.it] INFO: Saving data for TM70777: {'auction_closing_time': 1765037400.0, 'created_time': 1764878737.559548, 'last_price_update_time': 1764968484.422495}
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TM70777') HTTP/1.1" 204 0
2025-12-05 21:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:25 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: VL40071
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL40071%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for VL40071: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: JG92403
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG92403%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for JG92403: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: MR60103
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR60103%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for MR60103: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: SH45068
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH45068%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for SH45068: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: ZJ01897
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ01897%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for ZJ01897: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: HJ41912
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ41912%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for HJ41912: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: XL58334
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL58334%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for XL58334: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: NT50828
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT50828%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for NT50828: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: VW00442
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW00442%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for VW00442: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: PR91188
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for PR91188: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: JZ82526
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ82526%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for JZ82526: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: WZ58856
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ58856%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for WZ58856: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: ZD98375
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD98375%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for ZD98375: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: GL17856
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL17856%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for GL17856: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: SR77260
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR77260%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for SR77260: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: AH71898
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH71898%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for AH71898: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: FX72722
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX72722%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for FX72722: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: WR35053
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR35053%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for WR35053: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: KL97300
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL97300%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for KL97300: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: BA47590
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA47590%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for BA47590: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: GK18326
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK18326%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for GK18326: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: SJ73434
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ73434%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for SJ73434: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: GY55011
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for GY55011: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: JK28026
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK28026%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for JK28026: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: RA25408
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for RA25408: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: NR57705
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR57705%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for NR57705: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: PL31323
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL31323%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for PL31323: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: PZ69908
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ69908%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for PZ69908: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: TV43098
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV43098%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for TV43098: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: YU94462
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for YU94462: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: XW54555
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW54555%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for XW54555: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: UX53135
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX53135%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for UX53135: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: RU90797
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU90797%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for RU90797: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: TY32521
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY32521%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for TY32521: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: WN75078
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN75078%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for WN75078: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: SP74056
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP74056%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for SP74056: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: NY23809
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY23809%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for NY23809: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: DN37442
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN37442%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for DN37442: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: FM27207
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM27207%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for FM27207: 0
2025-12-05 21:01:25 [auto1.it] INFO: Found listing with ID: PV32269
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV32269%27 HTTP/1.1" 200 None
2025-12-05 21:01:25 [auto1.it] INFO: Scrape type for PV32269: 0
2025-12-05 21:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:26 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:26 [auto1.it] INFO: Found listing with ID: UL79452
2025-12-05 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL79452%27 HTTP/1.1" 200 None
2025-12-05 21:01:26 [auto1.it] INFO: Scrape type for UL79452: 0
2025-12-05 21:01:26 [auto1.it] INFO: Found listing with ID: DB84846
2025-12-05 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB84846%27 HTTP/1.1" 200 None
2025-12-05 21:01:26 [auto1.it] INFO: Scrape type for DB84846: 0
2025-12-05 21:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 21:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 21:01:27 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 21:01:27 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 21:01:27 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 42}
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201764536487 HTTP/1.1" 200 None
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AH29777') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AV64153') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CX68538') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DM52961') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GB81197') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HH59266') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JY13937') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NA46088') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PC08828') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SG67447') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XT09023') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ92102') HTTP/1.1" 204 0
2025-12-05 21:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZJ20493') HTTP/1.1" 204 0
2025-12-05 21:01:27 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (66 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_74_2025-12-05T21_00_01.jl
2025-12-05 21:01:27 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 451048,
'downloader/request_count': 202,
'downloader/request_method_count/GET': 184,
'downloader/request_method_count/POST': 18,
'downloader/response_bytes': 6193826,
'downloader/response_count': 202,
'downloader/response_status_count/200': 202,
'dupefilter/filtered': 3,
'elapsed_time_seconds': 75.429685,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2025, 12, 5, 21, 1, 27, 747906, tzinfo=datetime.timezone.utc),
'item_dropped_count': 25,
'item_dropped_reasons_count/DropItem': 25,
'item_scraped_count': 66,
'log_count/DEBUG': 2239,
'log_count/INFO': 2062,
'memusage/max': 149110784,
'memusage/startup': 127340544,
'request_depth_max': 19,
'response_received_count': 202,
'scheduler/dequeued': 202,
'scheduler/dequeued/memory': 202,
'scheduler/enqueued': 202,
'scheduler/enqueued/memory': 202,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 202,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.081268304371101,
'scrapy-zyte-api/mean_response_seconds': 2.095749906530502,
'scrapy-zyte-api/processed': 202,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 202,
'scrapy-zyte-api/request_args/experimental.requestCookies': 201,
'scrapy-zyte-api/request_args/experimental.responseCookies': 202,
'scrapy-zyte-api/request_args/httpRequestBody': 18,
'scrapy-zyte-api/request_args/httpRequestMethod': 18,
'scrapy-zyte-api/request_args/httpResponseBody': 202,
'scrapy-zyte-api/request_args/httpResponseHeaders': 202,
'scrapy-zyte-api/request_args/sessionContext': 202,
'scrapy-zyte-api/request_args/url': 202,
'scrapy-zyte-api/status_codes/200': 202,
'scrapy-zyte-api/success': 202,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2025, 12, 5, 21, 0, 12, 318221, tzinfo=datetime.timezone.utc)}
2025-12-05 21:01:27 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 21:01:27 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe9f8c18650>
2025-12-05 21:01:27 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe9f89a8910>