• It's recommended to check out the latest log via: the Stats page >> View log >> Tail

PROJECT (sourcing_v2), SPIDER (auto1.it)

2026-03-28 09:05:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 09:05:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 09:05:04 [auto1.it] INFO: Batch mode enabled: batch 2/2
2026-03-28 09:05:04 [auto1.it] INFO: Starting spider auto1.it
2026-03-28 09:05:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 09:05:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 09:05:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 09:05:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 09:05:04 [scrapy.extensions.telnet] INFO: Telnet Password: b62fdcf95b046409
2026-03-28 09:05:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 09:05:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_23_2026-03-28T09_05_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 09:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 09:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 09:05:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 09:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 09:05:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 09:05:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 09:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 09:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 09:05:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 09:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 09:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 09:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 09:05:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 09:05:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 09:05:05 [scrapy.core.engine] INFO: Spider opened
2026-03-28 09:05:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 09:05:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 09:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 09:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 09:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 09:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 09:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 09:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 09:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 09:05:30 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3437 | hits on page: 40
2026-03-28 09:05:30 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-28 09:05:30 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-28 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW36660%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for HW36660: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR61031%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for HR61031: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX37056%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for GX37056: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP24974%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for SP24974: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48756%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for WU48756: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28373%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for FV28373: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91137%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for WM91137: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU89130%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for BU89130: 1
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR74044%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for MR74044: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83443%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for JB83443: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU74019%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for RU74019: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY06096%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for NY06096: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD11193%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for DD11193: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU55073%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for TU55073: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC52693%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for JC52693: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA37529%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for BA37529: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR63683%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for PR63683: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC74563%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for KC74563: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB22824%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for MB22824: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW35507%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for NW35507: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG64342%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for AG64342: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC92896%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for RC92896: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK68121%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for WK68121: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: DR04246
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR04246%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for DR04246: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70792%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for MM70792: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP67579%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for VP67579: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM60926%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for VM60926: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY72509%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for RY72509: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE94474%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for UE94474: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: FC17573
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC17573%27 HTTP/1.1" 200 None
2026-03-28 09:05:31 [auto1.it] INFO: Scrape type for FC17573: 1
2026-03-28 09:05:31 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-28 09:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU48756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP24974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR61031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV28373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:32 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3438 | hits on page: 40
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: SF25356
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-28 09:05:32 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/HW36660/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: DR04246
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-28 09:05:32 [auto1.it] INFO: Found listing with ID: FC17573
2026-03-28 09:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM91137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU89130/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY06096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU55073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD11193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB83443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC52693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC17573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY72509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR74044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX37056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM60926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP24974> (referer: https://www.auto1.com/v1/car-details-view/SP24974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974
2026-03-28 09:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with scrape type 1
2026-03-28 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_a5d630862145b54aa78563bd349493d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_a5d630862145b54aa78563bd349493d2.jpg not downloaded yet
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_16e092c1518d78081221b13b6d9526a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_16e092c1518d78081221b13b6d9526a4.jpg not downloaded yet
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_e079166d0911fb5f3044d46bfb62d281.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_e079166d0911fb5f3044d46bfb62d281.jpg not downloaded yet
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_8a07fa7f46982ed27c52fc7068402fa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_8a07fa7f46982ed27c52fc7068402fa2.jpg not downloaded yet
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_0ebe23f8d4f05ef75ebc050ebebaa55c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_0ebe23f8d4f05ef75ebc050ebebaa55c.jpg not downloaded yet
2026-03-28 09:05:35 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3439 | hits on page: 40
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: FC17573
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP90035%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [auto1.it] INFO: Scrape type for AP90035: 1
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY89134%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [auto1.it] INFO: Scrape type for BY89134: 1
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU21056%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [auto1.it] INFO: Scrape type for MU21056: 1
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-28 09:05:35 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE56181%27 HTTP/1.1" 200 None
2026-03-28 09:05:35 [auto1.it] INFO: Scrape type for XE56181: 2
2026-03-28 09:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181
2026-03-28 09:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with scrape type 2
2026-03-28 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with scrape type 2
2026-03-28 09:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cba2e24f-1a46-5d0c-ab57-e4a78668ed98, identifier: XE56181
2026-03-28 09:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181
2026-03-28 09:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 09:05:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 09:05:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181
2026-03-28 09:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181 to the API
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:46Z',
 'fuel_type': 'petrol',
 'id': 'cba2e24f-1a46-5d0c-ab57-e4a78668ed98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE56181',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 86432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE56181%27 HTTP/1.1" 200 None
2026-03-28 09:05:36 [auto1.it] INFO: Saving data for XE56181: {'auction_closing_time': 1774884706.0, 'created_time': 1774343240.185057, 'last_price_update_time': 1774688736.53986}
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XE56181') HTTP/1.1" 204 0
2026-03-28 09:05:36 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-28 09:05:36 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP34925%27 HTTP/1.1" 200 None
2026-03-28 09:05:36 [auto1.it] INFO: Scrape type for CP34925: 2
2026-03-28 09:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925
2026-03-28 09:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06c7891-bfc2-53b7-b745-fff38cff534e with scrape type 2
2026-03-28 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e06c7891-bfc2-53b7-b745-fff38cff534e with scrape type 2
2026-03-28 09:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e06c7891-bfc2-53b7-b745-fff38cff534e, identifier: CP34925
2026-03-28 09:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 09:05:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 09:05:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925
2026-03-28 09:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925 to the API
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:24:49Z',
 'fuel_type': 'diesel',
 'id': 'e06c7891-bfc2-53b7-b745-fff38cff534e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP34925',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 206236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP34925%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Saving data for CP34925: {'auction_closing_time': 1774884289.0, 'created_time': 1774343247.091071, 'last_price_update_time': 1774688737.32922}
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CP34925') HTTP/1.1" 204 0
2026-03-28 09:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU89130> (referer: https://www.auto1.com/v1/car-details-view/BU89130/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM91137> (referer: https://www.auto1.com/v1/car-details-view/WM91137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB84582%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for UB84582: 1
2026-03-28 09:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY06096> (referer: https://www.auto1.com/v1/car-details-view/NY06096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB28979%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for CB28979: 1
2026-03-28 09:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW36660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG05236%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for RG05236: 1
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN63848%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for MN63848: 1
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC15950%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for GC15950: 1
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for YR71782: 1
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for RX70685: 1
2026-03-28 09:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130
2026-03-28 09:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3631ea6d-4553-5fb3-b183-983c0ed9560b with scrape type 1
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_88171b8e623e2139b072680555314fc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_88171b8e623e2139b072680555314fc9.jpg not downloaded yet
2026-03-28 09:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137
2026-03-28 09:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063a8e98-2d37-52d9-8db0-61c9688b6628 with scrape type 1
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 063a8e98-2d37-52d9-8db0-61c9688b6628
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_364410e1a4aa7db539ee785f23faa163.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_364410e1a4aa7db539ee785f23faa163.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_f0c3477d8df843e5864dceae05bcab20.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f0c3477d8df843e5864dceae05bcab20.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_f757decf7776b14b3ec78e728ec8dce2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f757decf7776b14b3ec78e728ec8dce2.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_da8c69b532bfe5d143407c6f0a487d4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_da8c69b532bfe5d143407c6f0a487d4d.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_5e56e2c41ce8a46374d4818eefbc9165.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_5e56e2c41ce8a46374d4818eefbc9165.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_f9613f104e8f740a464a91699f3d9405.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f9613f104e8f740a464a91699f3d9405.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_d6c1d1d91c051d893e72322721152ab4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_d6c1d1d91c051d893e72322721152ab4.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_fa0723528ce350ada78cc7aa22d0b5d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_fa0723528ce350ada78cc7aa22d0b5d3.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_beb3c93da42afb76218f3f924e830313.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_beb3c93da42afb76218f3f924e830313.jpg already downloaded
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F41%252Fe7410315b64686331201a2f9c19aeef3%252Fpa%252FWM91137_60f1248e4fa78143fb69f5b3718cf507.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_60f1248e4fa78143fb69f5b3718cf507.jpg already downloaded
2026-03-28 09:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 063a8e98-2d37-52d9-8db0-61c9688b6628, identifier: WM91137
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-28 09:05:37 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP42061%27 HTTP/1.1" 200 None
2026-03-28 09:05:37 [auto1.it] INFO: Scrape type for JP42061: 2
2026-03-28 09:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061
2026-03-28 09:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0d7d43-eb16-587c-9878-67034ac709a3 with scrape type 2
2026-03-28 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f0d7d43-eb16-587c-9878-67034ac709a3 with scrape type 2
2026-03-28 09:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f0d7d43-eb16-587c-9878-67034ac709a3, identifier: JP42061
2026-03-28 09:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137
2026-03-28 09:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137
2026-03-28 09:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137 to the API
2026-03-28 09:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WM91137>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:54:26Z',
 'fuel_type': 'diesel',
 'id': '063a8e98-2d37-52d9-8db0-61c9688b6628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91137',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 231381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_364410e1a4aa7db539ee785f23faa163.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f0c3477d8df843e5864dceae05bcab20.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f757decf7776b14b3ec78e728ec8dce2.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_da8c69b532bfe5d143407c6f0a487d4d.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_5e56e2c41ce8a46374d4818eefbc9165.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f9613f104e8f740a464a91699f3d9405.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_d6c1d1d91c051d893e72322721152ab4.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_fa0723528ce350ada78cc7aa22d0b5d3.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_beb3c93da42afb76218f3f924e830313.jpg',
                'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_60f1248e4fa78143fb69f5b3718cf507.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_364410e1a4aa7db539ee785f23faa163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f0c3477d8df843e5864dceae05bcab20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f757decf7776b14b3ec78e728ec8dce2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_da8c69b532bfe5d143407c6f0a487d4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_5e56e2c41ce8a46374d4818eefbc9165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_f9613f104e8f740a464a91699f3d9405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_d6c1d1d91c051d893e72322721152ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_fa0723528ce350ada78cc7aa22d0b5d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_beb3c93da42afb76218f3f924e830313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063a8e98-2d37-52d9-8db0-61c9688b6628/063a8e98-2d37-52d9-8db0-61c9688b6628_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/41/e7410315b64686331201a2f9c19aeef3/pa/WM91137_60f1248e4fa78143fb69f5b3718cf507.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91137%27 HTTP/1.1" 200 None
2026-03-28 09:05:38 [auto1.it] INFO: Saving data for WM91137: {'created_time': 1774688738.219023, 'last_price_update_time': 1774688738.219035, 'auction_closing_time': 1774886066.0}
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM91137') HTTP/1.1" 204 0
2026-03-28 09:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 09:05:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061
2026-03-28 09:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061 to the API
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:46:39Z',
 'fuel_type': 'diesel',
 'id': '4f0d7d43-eb16-587c-9878-67034ac709a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP42061',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 41268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP42061%27 HTTP/1.1" 200 None
2026-03-28 09:05:38 [auto1.it] INFO: Saving data for JP42061: {'auction_closing_time': 1774885599.0, 'created_time': 1774343222.028961, 'last_price_update_time': 1774688738.772589}
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP42061') HTTP/1.1" 204 0
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_d7a7c4604f72339c4b03f4c6c99182a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d7a7c4604f72339c4b03f4c6c99182a2.jpg not downloaded yet
2026-03-28 09:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096
2026-03-28 09:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67c0962-2149-53ef-89ab-d2dd2dc55dea with scrape type 1
2026-03-28 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_8f256f08ddd37638aa1f65ca67598516.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_8f256f08ddd37638aa1f65ca67598516.jpg not downloaded yet
2026-03-28 09:05:38 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR59695%27 HTTP/1.1" 200 None
2026-03-28 09:05:38 [auto1.it] INFO: Scrape type for PR59695: 2
2026-03-28 09:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695
2026-03-28 09:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with scrape type 2
2026-03-28 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with scrape type 2
2026-03-28 09:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32, identifier: PR59695
2026-03-28 09:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE94474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695
2026-03-28 09:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695
2026-03-28 09:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695 to the API
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:39:35Z',
 'fuel_type': 'diesel',
 'id': '1ca1147e-c98b-50aa-a8a4-ce0ec137be32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR59695',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 293356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-04',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR59695%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [auto1.it] INFO: Saving data for PR59695: {'auction_closing_time': 1774885175.0, 'created_time': 1773135199.707348, 'last_price_update_time': 1774688739.312226}
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR59695') HTTP/1.1" 204 0
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_d16301fff5df3e90e8a5c56f82f8defa.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d16301fff5df3e90e8a5c56f82f8defa.jpg not downloaded yet
2026-03-28 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_4a52346c467ffbb7928a100254963353.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_4a52346c467ffbb7928a100254963353.jpg not downloaded yet
2026-03-28 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV28373> (referer: https://www.auto1.com/v1/car-details-view/FV28373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU74019/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:39 [auto1.it] INFO: Found listing with ID: YC40082
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC40082%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [auto1.it] INFO: Scrape type for YC40082: 1
2026-03-28 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_270580f16bb13f61ca0d9820a0a88150.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_270580f16bb13f61ca0d9820a0a88150.jpg not downloaded yet
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_52a92f386d07fa4744ca194ee9243dd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_52a92f386d07fa4744ca194ee9243dd2.jpg not downloaded yet
2026-03-28 09:05:39 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL09653%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [auto1.it] INFO: Scrape type for AL09653: 2
2026-03-28 09:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653
2026-03-28 09:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb851146-0294-5f7d-8d49-24c1d25e3f83 with scrape type 2
2026-03-28 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb851146-0294-5f7d-8d49-24c1d25e3f83 with scrape type 2
2026-03-28 09:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb851146-0294-5f7d-8d49-24c1d25e3f83, identifier: AL09653
2026-03-28 09:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 09:05:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653
2026-03-28 09:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653 to the API
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:14:12Z',
 'fuel_type': 'petrol',
 'id': 'eb851146-0294-5f7d-8d49-24c1d25e3f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL09653',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 13384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-30',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.0 Mild-Hybrid Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2022}
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL09653%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [auto1.it] INFO: Saving data for AL09653: {'auction_closing_time': 1774883652.0, 'created_time': 1773911129.227054, 'last_price_update_time': 1774688739.953452}
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL09653') HTTP/1.1" 204 0
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_45186906cd7db9d5def4574d2e083007.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_45186906cd7db9d5def4574d2e083007.jpg not downloaded yet
2026-03-28 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_dd64612f3e7cd2b58cd4bb9be04457a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_dd64612f3e7cd2b58cd4bb9be04457a3.jpg not downloaded yet
2026-03-28 09:05:40 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK55043%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [auto1.it] INFO: Scrape type for DK55043: 1
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_11ff463a1f73be04280e65591c504ace.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_11ff463a1f73be04280e65591c504ace.jpg not downloaded yet
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_9ecc805bc1f0bc464ee7862c3615d6eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_9ecc805bc1f0bc464ee7862c3615d6eb.jpg not downloaded yet
2026-03-28 09:05:40 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-28 09:05:40 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-28 09:05:40 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU26591%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [auto1.it] INFO: Scrape type for NU26591: 1
2026-03-28 09:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373
2026-03-28 09:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with scrape type 1
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_24e1ab0b59b8179654cc80843ef2ee59.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_24e1ab0b59b8179654cc80843ef2ee59.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_0e9539fdb0f13a8a6124787ca5190fcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_0e9539fdb0f13a8a6124787ca5190fcb.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_f50fe6088c6cddaa752e1d8db1e2debc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_f50fe6088c6cddaa752e1d8db1e2debc.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_eb8d7077dc25f1b5b4333edc25c2316b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_eb8d7077dc25f1b5b4333edc25c2316b.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_bfbef2b7d8674f24ced6febf95d9f032.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_bfbef2b7d8674f24ced6febf95d9f032.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_c86b8b3fdbb40edaa4bf1af25da2434a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_c86b8b3fdbb40edaa4bf1af25da2434a.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_f1acc177d6a322949280ba30662779b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_f1acc177d6a322949280ba30662779b6.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_44bf63edada76770a2ad984f7df3d467.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_44bf63edada76770a2ad984f7df3d467.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_524a601b2fe50ad8e0e25a33eb6f4c0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_524a601b2fe50ad8e0e25a33eb6f4c0f.jpg already downloaded
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F1e%252Ffa1e1cf33134245fbd01e6767cf14e8c%252Fpa%252FFV28373_bc0bef8a287c5bd125156af4794a84ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_bc0bef8a287c5bd125156af4794a84ae.jpg already downloaded
2026-03-28 09:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171, identifier: FV28373
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_4bc01316abfe521bee2f1b929bebf3fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_4bc01316abfe521bee2f1b929bebf3fc.jpg not downloaded yet
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_5f84bc69dc668271b79c7c94cd2197cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_5f84bc69dc668271b79c7c94cd2197cf.jpg not downloaded yet
2026-03-28 09:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373
2026-03-28 09:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373
2026-03-28 09:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373 to the API
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FV28373>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:43Z',
 'fuel_type': 'petrol',
 'id': '0ebd2e9e-5aea-50c8-8a28-c4b7b9316171',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV28373',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 271786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_24e1ab0b59b8179654cc80843ef2ee59.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_0e9539fdb0f13a8a6124787ca5190fcb.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_f50fe6088c6cddaa752e1d8db1e2debc.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_eb8d7077dc25f1b5b4333edc25c2316b.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_bfbef2b7d8674f24ced6febf95d9f032.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_c86b8b3fdbb40edaa4bf1af25da2434a.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_f1acc177d6a322949280ba30662779b6.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_44bf63edada76770a2ad984f7df3d467.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_524a601b2fe50ad8e0e25a33eb6f4c0f.jpg',
                'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_bc0bef8a287c5bd125156af4794a84ae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_24e1ab0b59b8179654cc80843ef2ee59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_0e9539fdb0f13a8a6124787ca5190fcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2926434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_f50fe6088c6cddaa752e1d8db1e2debc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_eb8d7077dc25f1b5b4333edc25c2316b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_bfbef2b7d8674f24ced6febf95d9f032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_c86b8b3fdbb40edaa4bf1af25da2434a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_f1acc177d6a322949280ba30662779b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_44bf63edada76770a2ad984f7df3d467.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_524a601b2fe50ad8e0e25a33eb6f4c0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebd2e9e-5aea-50c8-8a28-c4b7b9316171/0ebd2e9e-5aea-50c8-8a28-c4b7b9316171_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/1e/fa1e1cf33134245fbd01e6767cf14e8c/pa/FV28373_bc0bef8a287c5bd125156af4794a84ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2007}
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28373%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [auto1.it] INFO: Saving data for FV28373: {'created_time': 1774688740.749906, 'last_price_update_time': 1774688740.749917, 'auction_closing_time': 1774884523.0}
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV28373') HTTP/1.1" 204 0
2026-03-28 09:05:40 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB42424%27 HTTP/1.1" 200 None
2026-03-28 09:05:40 [auto1.it] INFO: Scrape type for UB42424: 2
2026-03-28 09:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424
2026-03-28 09:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with scrape type 2
2026-03-28 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with scrape type 2
2026-03-28 09:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52404a5c-b63a-54c1-90ea-fd713bf0ad09, identifier: UB42424
2026-03-28 09:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424
2026-03-28 09:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424
2026-03-28 09:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424 to the API
2026-03-28 09:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:06:29Z',
 'fuel_type': 'petrol',
 'id': '52404a5c-b63a-54c1-90ea-fd713bf0ad09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB42424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 81135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2012}
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB42424%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [auto1.it] INFO: Saving data for UB42424: {'auction_closing_time': 1774883189.0, 'created_time': 1773130001.049804, 'last_price_update_time': 1774688741.204002}
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB42424') HTTP/1.1" 204 0
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_713c549d5c3c542e1bfcbc7a4ece068d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_713c549d5c3c542e1bfcbc7a4ece068d.jpg not downloaded yet
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_d099f6910cdbd0e3451cc5cf67076597.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_d099f6910cdbd0e3451cc5cf67076597.jpg not downloaded yet
2026-03-28 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC17573> (referer: https://www.auto1.com/v1/car-details-view/FC17573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD11193> (referer: https://www.auto1.com/v1/car-details-view/DD11193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:41 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV63380%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [auto1.it] INFO: Scrape type for RV63380: 1
2026-03-28 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB83443> (referer: https://www.auto1.com/v1/car-details-view/JB83443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC52693> (referer: https://www.auto1.com/v1/car-details-view/JC52693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU55073> (referer: https://www.auto1.com/v1/car-details-view/TU55073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_9a29287aff608d56e5c66a46517c68e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_9a29287aff608d56e5c66a46517c68e1.jpg not downloaded yet
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_0184fd15cb98debc49670b39dba5900d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_0184fd15cb98debc49670b39dba5900d.jpg not downloaded yet
2026-03-28 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:41 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE70672%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [auto1.it] INFO: Scrape type for JE70672: 1
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_a7e90131ea0740b867b5995aacdb261a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_a7e90131ea0740b867b5995aacdb261a.jpg not downloaded yet
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_7e54bbd88fe349813f36a92681d83c3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_7e54bbd88fe349813f36a92681d83c3b.jpg not downloaded yet
2026-03-28 09:05:41 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL44785%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [auto1.it] INFO: Scrape type for KL44785: 1
2026-03-28 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d7a7c4604f72339c4b03f4c6c99182a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_785a43e285efb10470b396d5b9f4fd30.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_785a43e285efb10470b396d5b9f4fd30.jpg not downloaded yet
2026-03-28 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_8f256f08ddd37638aa1f65ca67598516.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:41 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59167%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [auto1.it] INFO: Scrape type for TU59167: 1
2026-03-28 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d with identifier: FC17573
2026-03-28 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d with scrape type 1
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_a407dcbe836e9ad12559e9a002f4f2c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_a407dcbe836e9ad12559e9a002f4f2c1.jpg not downloaded yet
2026-03-28 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193
2026-03-28 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba7ed83d-5a68-53a2-9d12-f933046502c2 with scrape type 1
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_85ec8138f7393a6c386d3d44d55a8a11.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_85ec8138f7393a6c386d3d44d55a8a11.jpg not downloaded yet
2026-03-28 09:05:41 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04886%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [auto1.it] INFO: Scrape type for TD04886: 1
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_628365842fea76d22ab7d34a242075e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_628365842fea76d22ab7d34a242075e1.jpg not downloaded yet
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_ca109eaac1797a228125b74183983406.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_ca109eaac1797a228125b74183983406.jpg not downloaded yet
2026-03-28 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443
2026-03-28 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ad9e16-76e0-5254-8d06-518ec655d30e with scrape type 1
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_3aa727b7b782958bfd15af051fbbfc14.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_3aa727b7b782958bfd15af051fbbfc14.jpg not downloaded yet
2026-03-28 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693
2026-03-28 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with scrape type 1
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_359091951d3f5854f67718c7a15314d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_359091951d3f5854f67718c7a15314d4.jpg not downloaded yet
2026-03-28 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073
2026-03-28 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bcde52-4b02-5e6c-93e8-ace40d504d49 with scrape type 1
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_4aa4c317069ddd22d9c3095c6fe0f12f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_4aa4c317069ddd22d9c3095c6fe0f12f.jpg not downloaded yet
2026-03-28 09:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 09:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 09:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0668bc50>
2026-03-28 09:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_d7a7c4604f72339c4b03f4c6c99182a2.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d7a7c4604f72339c4b03f4c6c99182a2.jpg saved to cache
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:41 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK26905%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [auto1.it] INFO: Scrape type for NK26905: 1
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_29c16a87c4ae571aeb5d4f00848134e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_29c16a87c4ae571aeb5d4f00848134e6.jpg not downloaded yet
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_5c627c1d909b66d1e299d3b94ae338c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_5c627c1d909b66d1e299d3b94ae338c5.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_473216cb1e99f18af4f4628c91c98226.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_473216cb1e99f18af4f4628c91c98226.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_43fd07ae0e739b5c43215da814f1e623.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_43fd07ae0e739b5c43215da814f1e623.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_ad3f5dfabc7c092e62b50a096a98f89e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_ad3f5dfabc7c092e62b50a096a98f89e.jpg not downloaded yet
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_7e54bbd88fe349813f36a92681d83c3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:42 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_7d5b536613da049db9992027b5c562b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_7d5b536613da049db9992027b5c562b2.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_8bf33bd2636466d220f8992979669f8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_8bf33bd2636466d220f8992979669f8c.jpg not downloaded yet
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066b33d0>
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_8f256f08ddd37638aa1f65ca67598516.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_8f256f08ddd37638aa1f65ca67598516.jpg saved to cache
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_73c1990b173c2d18a03c8ed2a494a0fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_73c1990b173c2d18a03c8ed2a494a0fd.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_58f1b95d1e9f53094182e85c25b3099e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_58f1b95d1e9f53094182e85c25b3099e.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_0c876f349b9be9a7d97c297117d58ac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_0c876f349b9be9a7d97c297117d58ac0.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_c8aa81555746c9b96ee25f0bb1fe89a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_c8aa81555746c9b96ee25f0bb1fe89a2.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_0a3d77209138b40da1c1de55f6b554e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_0a3d77209138b40da1c1de55f6b554e3.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_a25452230887f94891b1591d6fe4c1e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_a25452230887f94891b1591d6fe4c1e0.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_f5d59a3309c18396196f4aca3646e28d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_f5d59a3309c18396196f4aca3646e28d.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_d368b99f375832c3dd6bf25486fd122f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_d368b99f375832c3dd6bf25486fd122f.jpg not downloaded yet
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_4bc01316abfe521bee2f1b929bebf3fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_a346da124a601c89b807b62f030282ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a346da124a601c89b807b62f030282ae.jpg not downloaded yet
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM60926> (referer: https://www.auto1.com/v1/car-details-view/VM60926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_d099f6910cdbd0e3451cc5cf67076597.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_713c549d5c3c542e1bfcbc7a4ece068d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_29175d74c6638590d590fcc5937aaf98.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_29175d74c6638590d590fcc5937aaf98.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_56a44cffade0459784b34f892eb466fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_56a44cffade0459784b34f892eb466fa.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_a0d4e82806c1c99b242d114f4f6129bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a0d4e82806c1c99b242d114f4f6129bb.jpg not downloaded yet
2026-03-28 09:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY72509> (referer: https://www.auto1.com/v1/car-details-view/RY72509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0f8710>
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_7e54bbd88fe349813f36a92681d83c3b.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_7e54bbd88fe349813f36a92681d83c3b.jpg saved to cache
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_7c81b8e5bfcf22251e45fd16603f5007.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_7c81b8e5bfcf22251e45fd16603f5007.jpg not downloaded yet
2026-03-28 09:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_5f84bc69dc668271b79c7c94cd2197cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_5c627c1d909b66d1e299d3b94ae338c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_cfc38f2b077c04af5d94c68ed47fbae4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_cfc38f2b077c04af5d94c68ed47fbae4.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_a329c43349ce8de1d3944c43fd67f7f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_a329c43349ce8de1d3944c43fd67f7f7.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_df307dafe4456bf71406cb3807798520.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_df307dafe4456bf71406cb3807798520.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_a1c6f95add5eb2feb3ed0a2eb7c430d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a1c6f95add5eb2feb3ed0a2eb7c430d3.jpg not downloaded yet
2026-03-28 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR74044> (referer: https://www.auto1.com/v1/car-details-view/MR74044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c29cf50>
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_4bc01316abfe521bee2f1b929bebf3fc.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_4bc01316abfe521bee2f1b929bebf3fc.jpg saved to cache
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_c659332e5a46fef1062714da9a4bc5d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_c659332e5a46fef1062714da9a4bc5d1.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_eeb7fc97f127cbb72c299f5e77afe884.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_eeb7fc97f127cbb72c299f5e77afe884.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_51d3c76ee57c65ef9637abc442431d88.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_51d3c76ee57c65ef9637abc442431d88.jpg not downloaded yet
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_50b335e09262b356586408848009ea59.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_50b335e09262b356586408848009ea59.jpg not downloaded yet
2026-03-28 09:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-03-28 09:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc81d046-8eab-513f-9931-4ce57eb14edb with scrape type 1
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_a1d206684b49207ffce4e50d3ca7b987.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_a1d206684b49207ffce4e50d3ca7b987.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_94fe17537953e8b0c771bf43301b6b89.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_94fe17537953e8b0c771bf43301b6b89.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_1184f32157a807fbd734c8d7a5bec780.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_1184f32157a807fbd734c8d7a5bec780.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_e2e3a0513249b8c388197cea2a00a267.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_e2e3a0513249b8c388197cea2a00a267.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg already downloaded
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F8d%252F2b8dafee63271b3329bd02e1d6cfe41b%252Fpa%252FVM60926_2756cf9168c54399328f52bd88e9fe59.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2756cf9168c54399328f52bd88e9fe59.jpg already downloaded
2026-03-28 09:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc81d046-8eab-513f-9931-4ce57eb14edb, identifier: VM60926
2026-03-28 09:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0e7450>
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_d099f6910cdbd0e3451cc5cf67076597.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_d099f6910cdbd0e3451cc5cf67076597.jpg saved to cache
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2c6e10>
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_713c549d5c3c542e1bfcbc7a4ece068d.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_713c549d5c3c542e1bfcbc7a4ece068d.jpg saved to cache
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509
2026-03-28 09:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf2e031-95b6-5525-a5be-f8d5544a276c with scrape type 1
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_b1fb27a0852499df17cbea15ce5a5d17.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_b1fb27a0852499df17cbea15ce5a5d17.jpg not downloaded yet
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_f5d59a3309c18396196f4aca3646e28d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_a25452230887f94891b1591d6fe4c1e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_bafcbf4ed88e532f0b7e8cf0c4f62ce0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_bafcbf4ed88e532f0b7e8cf0c4f62ce0.jpg not downloaded yet
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_cc14d9d37e7de2aaed4cb871c0c701af.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_cc14d9d37e7de2aaed4cb871c0c701af.jpg not downloaded yet
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_a791a2b994254e50f6bb8da7671e28ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a791a2b994254e50f6bb8da7671e28ed.jpg not downloaded yet
2026-03-28 09:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-03-28 09:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-03-28 09:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926 to the API
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM60926>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:17Z',
 'fuel_type': 'diesel',
 'id': 'bc81d046-8eab-513f-9931-4ce57eb14edb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM60926',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 196835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_a1d206684b49207ffce4e50d3ca7b987.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_94fe17537953e8b0c771bf43301b6b89.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_1184f32157a807fbd734c8d7a5bec780.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_e2e3a0513249b8c388197cea2a00a267.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg',
                'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2756cf9168c54399328f52bd88e9fe59.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2199669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_a1d206684b49207ffce4e50d3ca7b987.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1881165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_94fe17537953e8b0c771bf43301b6b89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2227305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_1184f32157a807fbd734c8d7a5bec780.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2281337,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_e2e3a0513249b8c388197cea2a00a267.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2108022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2091377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2756cf9168c54399328f52bd88e9fe59.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Advance BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance BlueMotion',
 'year': 2019}
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM60926%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [auto1.it] INFO: Saving data for VM60926: {'created_time': 1774688743.555664, 'last_price_update_time': 1774688743.555678, 'auction_closing_time': 1774885577.0}
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM60926') HTTP/1.1" 204 0
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_56a44cffade0459784b34f892eb466fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_d368b99f375832c3dd6bf25486fd122f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_4ebfa2b1ff6e4548b685806ef036d635.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_4ebfa2b1ff6e4548b685806ef036d635.jpg not downloaded yet
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_2f44b92dbd333cb6edd8aa55f879e19e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_2f44b92dbd333cb6edd8aa55f879e19e.jpg not downloaded yet
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP90035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB84582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066b8750>
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_5f84bc69dc668271b79c7c94cd2197cf.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_5f84bc69dc668271b79c7c94cd2197cf.jpg saved to cache
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06764c50>
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_5c627c1d909b66d1e299d3b94ae338c5.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_5c627c1d909b66d1e299d3b94ae338c5.jpg saved to cache
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a0d4e82806c1c99b242d114f4f6129bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_d43cf1c5e75d928367a1eb8e342e94da.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_d43cf1c5e75d928367a1eb8e342e94da.jpg not downloaded yet
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_86c3ad852cc123aeddd7cb362cd4686e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_86c3ad852cc123aeddd7cb362cd4686e.jpg not downloaded yet
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_5427a68bb735f3999c8eaa9d8fea5d25.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_5427a68bb735f3999c8eaa9d8fea5d25.jpg not downloaded yet
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY89134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX37056> (referer: https://www.auto1.com/v1/car-details-view/GX37056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU21056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044
2026-03-28 09:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with scrape type 1
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ea23627-d31f-50e7-baf2-c1656e2b8f3d
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_35c4bf67bca35678d2702550993e47d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_35c4bf67bca35678d2702550993e47d8.jpg already downloaded
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_8e184d993e46e6c39d89c5001ca0b49f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_8e184d993e46e6c39d89c5001ca0b49f.jpg already downloaded
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_754bd67331cbfc6543eae4ec3707dd87.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_754bd67331cbfc6543eae4ec3707dd87.jpg already downloaded
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_da488d2553241431d37e0b34661f1238.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_da488d2553241431d37e0b34661f1238.jpg already downloaded
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_842baf8100aa357fb6fb612ed4274695.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_842baf8100aa357fb6fb612ed4274695.jpg already downloaded
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_c558741b764b1157bf7204d004bca628.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_c558741b764b1157bf7204d004bca628.jpg already downloaded
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_1b709d62158b230bb27f6b4c14e8a153.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_1b709d62158b230bb27f6b4c14e8a153.jpg already downloaded
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_f00835107ab631d2aa4aabaa71ca9edb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_f00835107ab631d2aa4aabaa71ca9edb.jpg already downloaded
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_644139c10f57074f77d96bcc3d3a5dd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_644139c10f57074f77d96bcc3d3a5dd0.jpg already downloaded
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F10%252F1b101f6f77df22cc8eab32fd29ae22b1%252Fpa%252FMR74044_fa4f5a8af106b9fddc09e798d5011b10.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_fa4f5a8af106b9fddc09e798d5011b10.jpg already downloaded
2026-03-28 09:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d, identifier: MR74044
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_3a5fa2e105d3424ec07da0de621d7a34.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3a5fa2e105d3424ec07da0de621d7a34.jpg not downloaded yet
2026-03-28 09:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044
2026-03-28 09:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044 to the API
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR74044>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:52Z',
 'fuel_type': 'diesel',
 'id': '8ea23627-d31f-50e7-baf2-c1656e2b8f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR74044',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 392140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_35c4bf67bca35678d2702550993e47d8.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_8e184d993e46e6c39d89c5001ca0b49f.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_754bd67331cbfc6543eae4ec3707dd87.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_da488d2553241431d37e0b34661f1238.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_842baf8100aa357fb6fb612ed4274695.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_c558741b764b1157bf7204d004bca628.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_1b709d62158b230bb27f6b4c14e8a153.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_f00835107ab631d2aa4aabaa71ca9edb.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_644139c10f57074f77d96bcc3d3a5dd0.jpg',
                'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_fa4f5a8af106b9fddc09e798d5011b10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_35c4bf67bca35678d2702550993e47d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_8e184d993e46e6c39d89c5001ca0b49f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_754bd67331cbfc6543eae4ec3707dd87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_da488d2553241431d37e0b34661f1238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_842baf8100aa357fb6fb612ed4274695.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_c558741b764b1157bf7204d004bca628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_1b709d62158b230bb27f6b4c14e8a153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_f00835107ab631d2aa4aabaa71ca9edb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_644139c10f57074f77d96bcc3d3a5dd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea23627-d31f-50e7-baf2-c1656e2b8f3d/8ea23627-d31f-50e7-baf2-c1656e2b8f3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/10/1b101f6f77df22cc8eab32fd29ae22b1/pa/MR74044_fa4f5a8af106b9fddc09e798d5011b10.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR74044%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [auto1.it] INFO: Saving data for MR74044: {'created_time': 1774688744.673526, 'last_price_update_time': 1774688744.673536, 'auction_closing_time': 1774883212.0}
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR74044') HTTP/1.1" 204 0
2026-03-28 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_51d3c76ee57c65ef9637abc442431d88.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_eeb7fc97f127cbb72c299f5e77afe884.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a1c6f95add5eb2feb3ed0a2eb7c430d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_2868c39b0732c0200760209fa1c4c6ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_2868c39b0732c0200760209fa1c4c6ed.jpg not downloaded yet
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_3cfa0fc580d3858e0afec3963f65ccb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_3cfa0fc580d3858e0afec3963f65ccb8.jpg not downloaded yet
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_e8dde57f96ad474de69cacfd6d9d0567.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_e8dde57f96ad474de69cacfd6d9d0567.jpg not downloaded yet
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d8bd1d0>
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_f5d59a3309c18396196f4aca3646e28d.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_f5d59a3309c18396196f4aca3646e28d.jpg saved to cache
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065e99d0>
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_a25452230887f94891b1591d6fe4c1e0.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_a25452230887f94891b1591d6fe4c1e0.jpg saved to cache
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065e9890>
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_56a44cffade0459784b34f892eb466fa.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_56a44cffade0459784b34f892eb466fa.jpg saved to cache
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06789c50>
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_d368b99f375832c3dd6bf25486fd122f.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_d368b99f375832c3dd6bf25486fd122f.jpg saved to cache
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_50b335e09262b356586408848009ea59.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_9071f1b2202afade9ad5ada1f2cd4523.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_9071f1b2202afade9ad5ada1f2cd4523.jpg not downloaded yet
2026-03-28 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL44785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a346da124a601c89b807b62f030282ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_b1fb27a0852499df17cbea15ce5a5d17.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065b9850>
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_a0d4e82806c1c99b242d114f4f6129bb.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a0d4e82806c1c99b242d114f4f6129bb.jpg saved to cache
2026-03-28 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056
2026-03-28 09:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402cca32-ea88-5243-98dc-2e8998980a8f with scrape type 1
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_da925252dff7420ab06516ee691b5313.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_da925252dff7420ab06516ee691b5313.jpg not downloaded yet
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_dbb625690dcfd3307c921415d019e504.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_dbb625690dcfd3307c921415d019e504.jpg not downloaded yet
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c036f90>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_51d3c76ee57c65ef9637abc442431d88.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_51d3c76ee57c65ef9637abc442431d88.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1b6350>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_eeb7fc97f127cbb72c299f5e77afe884.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_eeb7fc97f127cbb72c299f5e77afe884.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06577390>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_a1c6f95add5eb2feb3ed0a2eb7c430d3.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a1c6f95add5eb2feb3ed0a2eb7c430d3.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_5fe5bda3ce117b084534d434fe924b11.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_5fe5bda3ce117b084534d434fe924b11.jpg not downloaded yet
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_bafcbf4ed88e532f0b7e8cf0c4f62ce0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a791a2b994254e50f6bb8da7671e28ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_d43cf1c5e75d928367a1eb8e342e94da.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_f9da231f7ece4ab52b7b42e1f176455b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_f9da231f7ece4ab52b7b42e1f176455b.jpg not downloaded yet
2026-03-28 09:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_cc14d9d37e7de2aaed4cb871c0c701af.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_5427a68bb735f3999c8eaa9d8fea5d25.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_86c3ad852cc123aeddd7cb362cd4686e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_e463c412a176bea8cf0aa4b5a639d433.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_e463c412a176bea8cf0aa4b5a639d433.jpg not downloaded yet
2026-03-28 09:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_3e33ab085ae6d233febd1be4278fa63d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3e33ab085ae6d233febd1be4278fa63d.jpg not downloaded yet
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066c8b90>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_50b335e09262b356586408848009ea59.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_50b335e09262b356586408848009ea59.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c062235d0>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_a346da124a601c89b807b62f030282ae.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a346da124a601c89b807b62f030282ae.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0674afd0>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_b1fb27a0852499df17cbea15ce5a5d17.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_b1fb27a0852499df17cbea15ce5a5d17.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_eeec0631cd8aa63a3e7895d899b3e6a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_eeec0631cd8aa63a3e7895d899b3e6a2.jpg not downloaded yet
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_c659332e5a46fef1062714da9a4bc5d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_4ebfa2b1ff6e4548b685806ef036d635.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_69c5416819e1ad48f583103c46f4c769.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_69c5416819e1ad48f583103c46f4c769.jpg not downloaded yet
2026-03-28 09:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_e8dde57f96ad474de69cacfd6d9d0567.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_2844ff4ba223498ecf372b2fe060687f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_2844ff4ba223498ecf372b2fe060687f.jpg not downloaded yet
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_317819e6c1d7a165e2604dfd7a5927b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_317819e6c1d7a165e2604dfd7a5927b3.jpg not downloaded yet
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_2f44b92dbd333cb6edd8aa55f879e19e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_51100d51345df688d8f59152e32c4cf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_51100d51345df688d8f59152e32c4cf4.jpg not downloaded yet
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066c8b90>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_bafcbf4ed88e532f0b7e8cf0c4f62ce0.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_bafcbf4ed88e532f0b7e8cf0c4f62ce0.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c146e10>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_a791a2b994254e50f6bb8da7671e28ed.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a791a2b994254e50f6bb8da7671e28ed.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1dd290>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_d43cf1c5e75d928367a1eb8e342e94da.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_d43cf1c5e75d928367a1eb8e342e94da.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c31b210>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_cc14d9d37e7de2aaed4cb871c0c701af.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_cc14d9d37e7de2aaed4cb871c0c701af.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0675d2d0>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_5427a68bb735f3999c8eaa9d8fea5d25.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_5427a68bb735f3999c8eaa9d8fea5d25.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c088c90>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_86c3ad852cc123aeddd7cb362cd4686e.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_86c3ad852cc123aeddd7cb362cd4686e.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_dbb625690dcfd3307c921415d019e504.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3a5fa2e105d3424ec07da0de621d7a34.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_d0fa02c67fa3ae67bb9803c6564b27f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_d0fa02c67fa3ae67bb9803c6564b27f2.jpg not downloaded yet
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_da925252dff7420ab06516ee691b5313.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_7f946a9c35f9ba3fd01950ef82d607a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_7f946a9c35f9ba3fd01950ef82d607a8.jpg not downloaded yet
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_5fe5bda3ce117b084534d434fe924b11.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_9071f1b2202afade9ad5ada1f2cd4523.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU74019> (referer: https://www.auto1.com/v1/car-details-view/RU74019/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1dd290>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_c659332e5a46fef1062714da9a4bc5d1.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_c659332e5a46fef1062714da9a4bc5d1.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2d1790>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_4ebfa2b1ff6e4548b685806ef036d635.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_4ebfa2b1ff6e4548b685806ef036d635.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1dded0>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_e8dde57f96ad474de69cacfd6d9d0567.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_e8dde57f96ad474de69cacfd6d9d0567.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06618490>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_2f44b92dbd333cb6edd8aa55f879e19e.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_2f44b92dbd333cb6edd8aa55f879e19e.jpg saved to cache
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_afe9ae14fb41e23cd6e8cd82dca8830d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_afe9ae14fb41e23cd6e8cd82dca8830d.jpg not downloaded yet
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3e33ab085ae6d233febd1be4278fa63d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_eeec0631cd8aa63a3e7895d899b3e6a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_88171b8e623e2139b072680555314fc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_2844ff4ba223498ecf372b2fe060687f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_0390275e5533342e90ed97e3b13aa41f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_0390275e5533342e90ed97e3b13aa41f.jpg not downloaded yet
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067eee50>
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_dbb625690dcfd3307c921415d019e504.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_dbb625690dcfd3307c921415d019e504.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c282650>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_3a5fa2e105d3424ec07da0de621d7a34.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3a5fa2e105d3424ec07da0de621d7a34.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06522410>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_da925252dff7420ab06516ee691b5313.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_da925252dff7420ab06516ee691b5313.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2b6890>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_5fe5bda3ce117b084534d434fe924b11.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_5fe5bda3ce117b084534d434fe924b11.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c282790>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_9071f1b2202afade9ad5ada1f2cd4523.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_9071f1b2202afade9ad5ada1f2cd4523.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019
2026-03-28 09:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with scrape type 1
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_a8939741bc158772792ffce4a620a1c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_a8939741bc158772792ffce4a620a1c2.jpg not downloaded yet
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_8d32f3127d82fa690d50d59902cee598.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_8d32f3127d82fa690d50d59902cee598.jpg not downloaded yet
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_cf6c0cb906e229c5d7c8385d9752ef1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cf6c0cb906e229c5d7c8385d9752ef1c.jpg not downloaded yet
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_69c5416819e1ad48f583103c46f4c769.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_317819e6c1d7a165e2604dfd7a5927b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_d0fa02c67fa3ae67bb9803c6564b27f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB84582> (referer: https://www.auto1.com/v1/car-details-view/UB84582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061f3850>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_3e33ab085ae6d233febd1be4278fa63d.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3e33ab085ae6d233febd1be4278fa63d.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067026d0>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_eeec0631cd8aa63a3e7895d899b3e6a2.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_eeec0631cd8aa63a3e7895d899b3e6a2.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06588410>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_88171b8e623e2139b072680555314fc9.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_88171b8e623e2139b072680555314fc9.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061f2790>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_2844ff4ba223498ecf372b2fe060687f.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_2844ff4ba223498ecf372b2fe060687f.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_9571394092d8ba228d09f9ce0e5c4fe8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9571394092d8ba228d09f9ce0e5c4fe8.jpg not downloaded yet
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_51100d51345df688d8f59152e32c4cf4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_e463c412a176bea8cf0aa4b5a639d433.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_afe9ae14fb41e23cd6e8cd82dca8830d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_f3d0f9ff53dc03ed2c52d3330358b19b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_f3d0f9ff53dc03ed2c52d3330358b19b.jpg not downloaded yet
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY89134> (referer: https://www.auto1.com/v1/car-details-view/BY89134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU21056> (referer: https://www.auto1.com/v1/car-details-view/MU21056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c16ed50>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_69c5416819e1ad48f583103c46f4c769.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_69c5416819e1ad48f583103c46f4c769.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0670bcd0>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_317819e6c1d7a165e2604dfd7a5927b3.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_317819e6c1d7a165e2604dfd7a5927b3.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065c0390>
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_d0fa02c67fa3ae67bb9803c6564b27f2.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_d0fa02c67fa3ae67bb9803c6564b27f2.jpg saved to cache
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582
2026-03-28 09:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63c9504-634c-5e16-83a4-c48ec6ff5396 with scrape type 1
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c63c9504-634c-5e16-83a4-c48ec6ff5396
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_5fa0f1a0511888813e99051b71f940e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_5fa0f1a0511888813e99051b71f940e0.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_ede1fbcf54611676298010f69ca1985f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_ede1fbcf54611676298010f69ca1985f.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_2d787bb3f81f5769c5dd8892b5d2656a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_2d787bb3f81f5769c5dd8892b5d2656a.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_00facf2bc6dacc82fa75c928d369a998.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_00facf2bc6dacc82fa75c928d369a998.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_afe07d8fd3b75d8cb4a0b52c1a146a8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_afe07d8fd3b75d8cb4a0b52c1a146a8c.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_bb6a5ee8ee40e6d25323f52d21311b1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_bb6a5ee8ee40e6d25323f52d21311b1b.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_a3a9e4bc8b9a2fd67d5c2dc5068db92e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_a3a9e4bc8b9a2fd67d5c2dc5068db92e.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_02b7faa3a645e50cadefef23abfca544.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_02b7faa3a645e50cadefef23abfca544.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_d3fee5dca4bff3c3ea39583b83c5a2c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_d3fee5dca4bff3c3ea39583b83c5a2c9.jpg already downloaded
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F33%252F8e33b207c4d29a15eed9b41ef2f41d3e%252Fpa%252FUB84582_ab88efdd2377c14d31ff74aba2add2a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_ab88efdd2377c14d31ff74aba2add2a9.jpg already downloaded
2026-03-28 09:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c63c9504-634c-5e16-83a4-c48ec6ff5396, identifier: UB84582
2026-03-28 09:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582
2026-03-28 09:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 09:05:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582
2026-03-28 09:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582 to the API
2026-03-28 09:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB84582>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:00Z',
 'fuel_type': 'petrol',
 'id': 'c63c9504-634c-5e16-83a4-c48ec6ff5396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84582',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 43968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_5fa0f1a0511888813e99051b71f940e0.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_ede1fbcf54611676298010f69ca1985f.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_2d787bb3f81f5769c5dd8892b5d2656a.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_00facf2bc6dacc82fa75c928d369a998.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_afe07d8fd3b75d8cb4a0b52c1a146a8c.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_bb6a5ee8ee40e6d25323f52d21311b1b.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_a3a9e4bc8b9a2fd67d5c2dc5068db92e.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_02b7faa3a645e50cadefef23abfca544.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_d3fee5dca4bff3c3ea39583b83c5a2c9.jpg',
                'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_ab88efdd2377c14d31ff74aba2add2a9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_5fa0f1a0511888813e99051b71f940e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_ede1fbcf54611676298010f69ca1985f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_2d787bb3f81f5769c5dd8892b5d2656a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_00facf2bc6dacc82fa75c928d369a998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_afe07d8fd3b75d8cb4a0b52c1a146a8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2923359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_bb6a5ee8ee40e6d25323f52d21311b1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2761592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_a3a9e4bc8b9a2fd67d5c2dc5068db92e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_02b7faa3a645e50cadefef23abfca544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_d3fee5dca4bff3c3ea39583b83c5a2c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63c9504-634c-5e16-83a4-c48ec6ff5396/c63c9504-634c-5e16-83a4-c48ec6ff5396_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/33/8e33b207c4d29a15eed9b41ef2f41d3e/pa/UB84582_ab88efdd2377c14d31ff74aba2add2a9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2016}
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB84582%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [auto1.it] INFO: Saving data for UB84582: {'created_time': 1774688748.628153, 'last_price_update_time': 1774688748.628163, 'auction_closing_time': 1774885320.0}
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB84582') HTTP/1.1" 204 0
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_3cfa0fc580d3858e0afec3963f65ccb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_8e4b7af1d1cdda6afc75fd97c9b6fce9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_8e4b7af1d1cdda6afc75fd97c9b6fce9.jpg not downloaded yet
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP90035> (referer: https://www.auto1.com/v1/car-details-view/AP90035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_0a3d77209138b40da1c1de55f6b554e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_2868c39b0732c0200760209fa1c4c6ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_f9da231f7ece4ab52b7b42e1f176455b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL44785> (referer: https://www.auto1.com/v1/car-details-view/KL44785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_df307dafe4456bf71406cb3807798520.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_a8939741bc158772792ffce4a620a1c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_0390275e5533342e90ed97e3b13aa41f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_beba3bc525f7015496d95a17a1422b19.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_beba3bc525f7015496d95a17a1422b19.jpg not downloaded yet
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065c3850>
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_51100d51345df688d8f59152e32c4cf4.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_51100d51345df688d8f59152e32c4cf4.jpg saved to cache
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c13fc10>
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_e463c412a176bea8cf0aa4b5a639d433.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_e463c412a176bea8cf0aa4b5a639d433.jpg saved to cache
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c107110>
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_afe9ae14fb41e23cd6e8cd82dca8830d.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_afe9ae14fb41e23cd6e8cd82dca8830d.jpg saved to cache
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134
2026-03-28 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc71848a-b641-55d6-a77a-76af8789aad2 with scrape type 1
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fc71848a-b641-55d6-a77a-76af8789aad2
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_044d6a11ec3350aa4fc9d0ab4506c53d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_044d6a11ec3350aa4fc9d0ab4506c53d.jpg not downloaded yet
2026-03-28 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056
2026-03-28 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64bdd1b-2b2c-560e-97c7-c114510cb31e with scrape type 1
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_beb59f8862a5bbf4e64d9ceadcdd641e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_beb59f8862a5bbf4e64d9ceadcdd641e.jpg not downloaded yet
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_81c62d3b657604d0f6d95c9a89895ac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_81c62d3b657604d0f6d95c9a89895ac0.jpg not downloaded yet
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_a329c43349ce8de1d3944c43fd67f7f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_addb8c2d2ec624c8a002c492a115a286.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_addb8c2d2ec624c8a002c492a115a286.jpg not downloaded yet
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_a77af68a3afc7953af2614890c38650a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_a77af68a3afc7953af2614890c38650a.jpg not downloaded yet
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cf6c0cb906e229c5d7c8385d9752ef1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_8d32f3127d82fa690d50d59902cee598.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_cfce690f254396eb1831e8e96347f150.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cfce690f254396eb1831e8e96347f150.jpg not downloaded yet
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06737410>
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_3cfa0fc580d3858e0afec3963f65ccb8.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_3cfa0fc580d3858e0afec3963f65ccb8.jpg saved to cache
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035
2026-03-28 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8e3ceca-7eaa-5a05-bed5-5875453c8639 with scrape type 1
2026-03-28 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a8e3ceca-7eaa-5a05-bed5-5875453c8639
2026-03-28 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_fa38d1497d5fc1c9f541df692baa9837.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_fa38d1497d5fc1c9f541df692baa9837.jpg not downloaded yet
2026-03-28 09:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061ddb10>
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_0a3d77209138b40da1c1de55f6b554e3.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_0a3d77209138b40da1c1de55f6b554e3.jpg saved to cache
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c04e750>
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_2868c39b0732c0200760209fa1c4c6ed.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_2868c39b0732c0200760209fa1c4c6ed.jpg saved to cache
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06575850>
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fd1%252F7ad12a18c69baf059e6b84e4b9111f74%252Fpa%252FRY72509_f9da231f7ece4ab52b7b42e1f176455b.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_f9da231f7ece4ab52b7b42e1f176455b.jpg saved to cache
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdf2e031-95b6-5525-a5be-f8d5544a276c
2026-03-28 09:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdf2e031-95b6-5525-a5be-f8d5544a276c, skipping ID generation
2026-03-28 09:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf2e031-95b6-5525-a5be-f8d5544a276c with scrape type 1
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdf2e031-95b6-5525-a5be-f8d5544a276c sending to next pipeline
2026-03-28 09:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bdf2e031-95b6-5525-a5be-f8d5544a276c, identifier: RY72509
2026-03-28 09:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785
2026-03-28 09:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b425b7a-1a1e-5424-811c-d835384a92a0 with scrape type 1
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_93e6b83b7719f94309f18d95f1a43e8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_93e6b83b7719f94309f18d95f1a43e8b.jpg not downloaded yet
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0659a7d0>
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_df307dafe4456bf71406cb3807798520.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_df307dafe4456bf71406cb3807798520.jpg saved to cache
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067b91d0>
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_a8939741bc158772792ffce4a620a1c2.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_a8939741bc158772792ffce4a620a1c2.jpg saved to cache
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06575fd0>
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_0390275e5533342e90ed97e3b13aa41f.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_0390275e5533342e90ed97e3b13aa41f.jpg saved to cache
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_3e5330dd59be568514bc6dac897a12c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_3e5330dd59be568514bc6dac897a12c3.jpg not downloaded yet
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_ccca67e9f7da89eb6df3886e2ff72056.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_ccca67e9f7da89eb6df3886e2ff72056.jpg not downloaded yet
2026-03-28 09:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509
2026-03-28 09:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509
2026-03-28 09:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509 to the API
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_f9da231f7ece4ab52b7b42e1f176455b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:15:42Z',
 'fuel_type': 'diesel',
 'id': 'bdf2e031-95b6-5525-a5be-f8d5544a276c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY72509',
 'listing': 'auction',
 'location': 'IT, Frosinone',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 133242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_b1fb27a0852499df17cbea15ce5a5d17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_2f44b92dbd333cb6edd8aa55f879e19e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3a5fa2e105d3424ec07da0de621d7a34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_9071f1b2202afade9ad5ada1f2cd4523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_dbb625690dcfd3307c921415d019e504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_f9da231f7ece4ab52b7b42e1f176455b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_3e33ab085ae6d233febd1be4278fa63d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_69c5416819e1ad48f583103c46f4c769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_317819e6c1d7a165e2604dfd7a5927b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2e031-95b6-5525-a5be-f8d5544a276c/bdf2e031-95b6-5525-a5be-f8d5544a276c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/d1/7ad12a18c69baf059e6b84e4b9111f74/pa/RY72509_d0fa02c67fa3ae67bb9803c6564b27f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY72509%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [auto1.it] INFO: Saving data for RY72509: {'created_time': 1774688749.895228, 'last_price_update_time': 1774688749.895237, 'auction_closing_time': 1774883742.0}
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY72509') HTTP/1.1" 204 0
2026-03-28 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_7c81b8e5bfcf22251e45fd16603f5007.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_9e0bda57553e4a3f7339cd790f8c59fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9e0bda57553e4a3f7339cd790f8c59fc.jpg not downloaded yet
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_4c51c1404c0d1beaef68d87ffaeb7ca1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_4c51c1404c0d1beaef68d87ffaeb7ca1.jpg not downloaded yet
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_4d0c58c3bd1bc1f5fedea86b9214b92a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_4d0c58c3bd1bc1f5fedea86b9214b92a.jpg not downloaded yet
2026-03-28 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_c8aa81555746c9b96ee25f0bb1fe89a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_f3d0f9ff53dc03ed2c52d3330358b19b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_cfc38f2b077c04af5d94c68ed47fbae4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_bb0842ee31a747a348d55185e77d6882.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_bb0842ee31a747a348d55185e77d6882.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_55daadd2de493945bef2d1165e36363e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55daadd2de493945bef2d1165e36363e.jpg not downloaded yet
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_0c876f349b9be9a7d97c297117d58ac0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_29175d74c6638590d590fcc5937aaf98.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_dc4f4a237fcd7c2952ad85e456e54596.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_dc4f4a237fcd7c2952ad85e456e54596.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_89808314fc40e13c229ad7c362971cb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_89808314fc40e13c229ad7c362971cb2.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_0607f24215da2897df3827d7eac9f140.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0607f24215da2897df3827d7eac9f140.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_9ae293943ebcbdd9e57ac46fb8dcdd1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_9ae293943ebcbdd9e57ac46fb8dcdd1d.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_66458fccf3fdb90812dc45302f403d31.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_66458fccf3fdb90812dc45302f403d31.jpg not downloaded yet
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c277d90>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_a329c43349ce8de1d3944c43fd67f7f7.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_a329c43349ce8de1d3944c43fd67f7f7.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1ab6d0>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_cf6c0cb906e229c5d7c8385d9752ef1c.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cf6c0cb906e229c5d7c8385d9752ef1c.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066ecb50>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_8d32f3127d82fa690d50d59902cee598.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_8d32f3127d82fa690d50d59902cee598.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_70879cc066e0273ef3d592a2d6b0f7f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_70879cc066e0273ef3d592a2d6b0f7f5.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_9b7f368e1b52482e27fbd9f32dfa79b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_9b7f368e1b52482e27fbd9f32dfa79b3.jpg not downloaded yet
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_58f1b95d1e9f53094182e85c25b3099e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_8bf33bd2636466d220f8992979669f8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_554926fa1562783f60200a009451b1b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_554926fa1562783f60200a009451b1b0.jpg not downloaded yet
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1dc110>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_7c81b8e5bfcf22251e45fd16603f5007.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_7c81b8e5bfcf22251e45fd16603f5007.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_8e4b7af1d1cdda6afc75fd97c9b6fce9.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_73c1990b173c2d18a03c8ed2a494a0fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_25c530d217430df7e89e1d336c09088b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_25c530d217430df7e89e1d336c09088b.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_7065e0a559d327fc0544ba5d2816579c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_7065e0a559d327fc0544ba5d2816579c.jpg not downloaded yet
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c062750d0>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_c8aa81555746c9b96ee25f0bb1fe89a2.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_c8aa81555746c9b96ee25f0bb1fe89a2.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065db110>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_f3d0f9ff53dc03ed2c52d3330358b19b.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_f3d0f9ff53dc03ed2c52d3330358b19b.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065153d0>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_cfc38f2b077c04af5d94c68ed47fbae4.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_cfc38f2b077c04af5d94c68ed47fbae4.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066eedd0>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_0c876f349b9be9a7d97c297117d58ac0.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_0c876f349b9be9a7d97c297117d58ac0.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06731490>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_29175d74c6638590d590fcc5937aaf98.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_29175d74c6638590d590fcc5937aaf98.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_8320f596a7b69724d1b33dfe84216fed.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_8320f596a7b69724d1b33dfe84216fed.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_c62e4ca2a72272b15610061cd2cda452.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_c62e4ca2a72272b15610061cd2cda452.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_e45d02cb692b05294106a80a252c456c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e45d02cb692b05294106a80a252c456c.jpg not downloaded yet
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_beb59f8862a5bbf4e64d9ceadcdd641e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_7d5b536613da049db9992027b5c562b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_81c62d3b657604d0f6d95c9a89895ac0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_044d6a11ec3350aa4fc9d0ab4506c53d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_55ad760abd825eaafe150fd3edf6c54e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55ad760abd825eaafe150fd3edf6c54e.jpg not downloaded yet
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c18e210>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_58f1b95d1e9f53094182e85c25b3099e.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_58f1b95d1e9f53094182e85c25b3099e.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066dfb90>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_8bf33bd2636466d220f8992979669f8c.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_8bf33bd2636466d220f8992979669f8c.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2b7810>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_8e4b7af1d1cdda6afc75fd97c9b6fce9.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_8e4b7af1d1cdda6afc75fd97c9b6fce9.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0624e750>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_73c1990b173c2d18a03c8ed2a494a0fd.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_73c1990b173c2d18a03c8ed2a494a0fd.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_93e6b83b7719f94309f18d95f1a43e8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_0677d2ba94a430bc89c620315bb5c500.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0677d2ba94a430bc89c620315bb5c500.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_def39d2b3ca4cb0e73576ce86186ed91.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_def39d2b3ca4cb0e73576ce86186ed91.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_e512382894b54e721d2c4940eac557ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e512382894b54e721d2c4940eac557ea.jpg not downloaded yet
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_5cae0a90fa437f6d44602fdd59009a37.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_5cae0a90fa437f6d44602fdd59009a37.jpg not downloaded yet
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0bf790>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_beb59f8862a5bbf4e64d9ceadcdd641e.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_beb59f8862a5bbf4e64d9ceadcdd641e.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0c3d90>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_7d5b536613da049db9992027b5c562b2.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_7d5b536613da049db9992027b5c562b2.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2c6110>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_81c62d3b657604d0f6d95c9a89895ac0.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_81c62d3b657604d0f6d95c9a89895ac0.jpg saved to cache
2026-03-28 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06711f10>
2026-03-28 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_044d6a11ec3350aa4fc9d0ab4506c53d.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_044d6a11ec3350aa4fc9d0ab4506c53d.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc71848a-b641-55d6-a77a-76af8789aad2
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_fa38d1497d5fc1c9f541df692baa9837.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_75a317e7ced1a9d94cdf4e745965fe13.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_75a317e7ced1a9d94cdf4e745965fe13.jpg not downloaded yet
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_bb0842ee31a747a348d55185e77d6882.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55daadd2de493945bef2d1165e36363e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_3e5330dd59be568514bc6dac897a12c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_d512c92eb12574b426b98f3011d36178.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_d512c92eb12574b426b98f3011d36178.jpg not downloaded yet
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c092f10>
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_93e6b83b7719f94309f18d95f1a43e8b.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_93e6b83b7719f94309f18d95f1a43e8b.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_7f946a9c35f9ba3fd01950ef82d607a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db51590>
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_fa38d1497d5fc1c9f541df692baa9837.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_fa38d1497d5fc1c9f541df692baa9837.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8e3ceca-7eaa-5a05-bed5-5875453c8639
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9571394092d8ba228d09f9ce0e5c4fe8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c093cd0>
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_bb0842ee31a747a348d55185e77d6882.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_bb0842ee31a747a348d55185e77d6882.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc71848a-b641-55d6-a77a-76af8789aad2
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c270910>
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_55daadd2de493945bef2d1165e36363e.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55daadd2de493945bef2d1165e36363e.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061db510>
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_3e5330dd59be568514bc6dac897a12c3.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_3e5330dd59be568514bc6dac897a12c3.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc71848a-b641-55d6-a77a-76af8789aad2
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_7065e0a559d327fc0544ba5d2816579c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_9b7f368e1b52482e27fbd9f32dfa79b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_9ae293943ebcbdd9e57ac46fb8dcdd1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_70879cc066e0273ef3d592a2d6b0f7f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_ccca67e9f7da89eb6df3886e2ff72056.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d8b0a10>
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F26%252F8a2690ccd17ba08ee667341bf62c6de7%252Fpa%252FGX37056_7f946a9c35f9ba3fd01950ef82d607a8.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_7f946a9c35f9ba3fd01950ef82d607a8.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 402cca32-ea88-5243-98dc-2e8998980a8f
2026-03-28 09:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 402cca32-ea88-5243-98dc-2e8998980a8f, skipping ID generation
2026-03-28 09:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402cca32-ea88-5243-98dc-2e8998980a8f with scrape type 1
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 402cca32-ea88-5243-98dc-2e8998980a8f sending to next pipeline
2026-03-28 09:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 402cca32-ea88-5243-98dc-2e8998980a8f, identifier: GX37056
2026-03-28 09:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d8b0750>
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_9571394092d8ba228d09f9ce0e5c4fe8.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9571394092d8ba228d09f9ce0e5c4fe8.jpg saved to cache
2026-03-28 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 09:05:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056
2026-03-28 09:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056 to the API
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_7f946a9c35f9ba3fd01950ef82d607a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'diesel',
 'id': '402cca32-ea88-5243-98dc-2e8998980a8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX37056',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 106692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_da925252dff7420ab06516ee691b5313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_5fe5bda3ce117b084534d434fe924b11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_e463c412a176bea8cf0aa4b5a639d433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_eeec0631cd8aa63a3e7895d899b3e6a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_2844ff4ba223498ecf372b2fe060687f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_51100d51345df688d8f59152e32c4cf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2821498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_7f946a9c35f9ba3fd01950ef82d607a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_afe9ae14fb41e23cd6e8cd82dca8830d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_0390275e5533342e90ed97e3b13aa41f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402cca32-ea88-5243-98dc-2e8998980a8f/402cca32-ea88-5243-98dc-2e8998980a8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/26/8a2690ccd17ba08ee667341bf62c6de7/pa/GX37056_8d32f3127d82fa690d50d59902cee598.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX37056%27 HTTP/1.1" 200 None
2026-03-28 09:05:52 [auto1.it] INFO: Saving data for GX37056: {'created_time': 1774688752.851691, 'last_price_update_time': 1774688752.851701, 'auction_closing_time': 1774882807.0}
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX37056') HTTP/1.1" 204 0
2026-03-28 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e512382894b54e721d2c4940eac557ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_25c530d217430df7e89e1d336c09088b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_554926fa1562783f60200a009451b1b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0a0b10>
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_7065e0a559d327fc0544ba5d2816579c.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_7065e0a559d327fc0544ba5d2816579c.jpg saved to cache
2026-03-28 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06592c90>
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_9b7f368e1b52482e27fbd9f32dfa79b3.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_9b7f368e1b52482e27fbd9f32dfa79b3.jpg saved to cache
2026-03-28 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0b3dd0>
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_9ae293943ebcbdd9e57ac46fb8dcdd1d.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_9ae293943ebcbdd9e57ac46fb8dcdd1d.jpg saved to cache
2026-03-28 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc71848a-b641-55d6-a77a-76af8789aad2
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065938d0>
2026-03-28 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_70879cc066e0273ef3d592a2d6b0f7f5.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_70879cc066e0273ef3d592a2d6b0f7f5.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8e3ceca-7eaa-5a05-bed5-5875453c8639
2026-03-28 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06544710>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_ccca67e9f7da89eb6df3886e2ff72056.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_ccca67e9f7da89eb6df3886e2ff72056.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_def39d2b3ca4cb0e73576ce86186ed91.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_66458fccf3fdb90812dc45302f403d31.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c297810>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_e512382894b54e721d2c4940eac557ea.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e512382894b54e721d2c4940eac557ea.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067ec950>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_25c530d217430df7e89e1d336c09088b.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_25c530d217430df7e89e1d336c09088b.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8e3ceca-7eaa-5a05-bed5-5875453c8639
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067edc50>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_554926fa1562783f60200a009451b1b0.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_554926fa1562783f60200a009451b1b0.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0677d2ba94a430bc89c620315bb5c500.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_75a317e7ced1a9d94cdf4e745965fe13.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e45d02cb692b05294106a80a252c456c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_d512c92eb12574b426b98f3011d36178.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066ed690>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_def39d2b3ca4cb0e73576ce86186ed91.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_def39d2b3ca4cb0e73576ce86186ed91.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c318690>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_66458fccf3fdb90812dc45302f403d31.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_66458fccf3fdb90812dc45302f403d31.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0607f24215da2897df3827d7eac9f140.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2945d0>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_0677d2ba94a430bc89c620315bb5c500.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0677d2ba94a430bc89c620315bb5c500.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06223990>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_75a317e7ced1a9d94cdf4e745965fe13.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_75a317e7ced1a9d94cdf4e745965fe13.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c74df90>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_e45d02cb692b05294106a80a252c456c.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e45d02cb692b05294106a80a252c456c.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066ba810>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_d512c92eb12574b426b98f3011d36178.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_d512c92eb12574b426b98f3011d36178.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_89808314fc40e13c229ad7c362971cb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_4d0c58c3bd1bc1f5fedea86b9214b92a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_4c51c1404c0d1beaef68d87ffaeb7ca1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_dc4f4a237fcd7c2952ad85e456e54596.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_c62e4ca2a72272b15610061cd2cda452.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0ab310>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_0607f24215da2897df3827d7eac9f140.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0607f24215da2897df3827d7eac9f140.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_8320f596a7b69724d1b33dfe84216fed.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55ad760abd825eaafe150fd3edf6c54e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_5cae0a90fa437f6d44602fdd59009a37.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0ede50>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_89808314fc40e13c229ad7c362971cb2.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_89808314fc40e13c229ad7c362971cb2.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8e3ceca-7eaa-5a05-bed5-5875453c8639
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c173c10>
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F27%252F9727c131efd43dd02a9b3073c6ffa4ad%252Fpa%252FKL44785_4d0c58c3bd1bc1f5fedea86b9214b92a.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_4d0c58c3bd1bc1f5fedea86b9214b92a.jpg saved to cache
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b425b7a-1a1e-5424-811c-d835384a92a0
2026-03-28 09:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b425b7a-1a1e-5424-811c-d835384a92a0, skipping ID generation
2026-03-28 09:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b425b7a-1a1e-5424-811c-d835384a92a0 with scrape type 1
2026-03-28 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b425b7a-1a1e-5424-811c-d835384a92a0 sending to next pipeline
2026-03-28 09:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b425b7a-1a1e-5424-811c-d835384a92a0, identifier: KL44785
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c1b4f0090>
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_4c51c1404c0d1beaef68d87ffaeb7ca1.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_4c51c1404c0d1beaef68d87ffaeb7ca1.jpg saved to cache
2026-03-28 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8e3ceca-7eaa-5a05-bed5-5875453c8639
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06593c50>
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_dc4f4a237fcd7c2952ad85e456e54596.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_dc4f4a237fcd7c2952ad85e456e54596.jpg saved to cache
2026-03-28 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066e9ed0>
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F5c%252F385c8c3670bb27337156a20ba1a3efb3%252Fpa%252FAP90035_c62e4ca2a72272b15610061cd2cda452.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_c62e4ca2a72272b15610061cd2cda452.jpg saved to cache
2026-03-28 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8e3ceca-7eaa-5a05-bed5-5875453c8639
2026-03-28 09:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8e3ceca-7eaa-5a05-bed5-5875453c8639, skipping ID generation
2026-03-28 09:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8e3ceca-7eaa-5a05-bed5-5875453c8639 with scrape type 1
2026-03-28 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8e3ceca-7eaa-5a05-bed5-5875453c8639 sending to next pipeline
2026-03-28 09:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8e3ceca-7eaa-5a05-bed5-5875453c8639, identifier: AP90035
2026-03-28 09:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 09:05:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785
2026-03-28 09:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785 to the API
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_4d0c58c3bd1bc1f5fedea86b9214b92a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:29:39Z',
 'fuel_type': 'diesel',
 'id': '7b425b7a-1a1e-5424-811c-d835384a92a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL44785',
 'listing': 'auction',
 'location': 'IT, Treviso',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 261183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_93e6b83b7719f94309f18d95f1a43e8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_4d0c58c3bd1bc1f5fedea86b9214b92a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0607f24215da2897df3827d7eac9f140.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_9b7f368e1b52482e27fbd9f32dfa79b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_7065e0a559d327fc0544ba5d2816579c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e45d02cb692b05294106a80a252c456c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_0677d2ba94a430bc89c620315bb5c500.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_e512382894b54e721d2c4940eac557ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_75a317e7ced1a9d94cdf4e745965fe13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b425b7a-1a1e-5424-811c-d835384a92a0/7b425b7a-1a1e-5424-811c-d835384a92a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/27/9727c131efd43dd02a9b3073c6ffa4ad/pa/KL44785_d512c92eb12574b426b98f3011d36178.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-27',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM Panorama Family L2H1 130 Multijet',
 'transmission': 'manual',
 'trim': 'Panorama Family L2H1 130 Multijet',
 'year': 2012}
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL44785%27 HTTP/1.1" 200 None
2026-03-28 09:05:54 [auto1.it] INFO: Saving data for KL44785: {'created_time': 1774688754.772622, 'last_price_update_time': 1774688754.772631, 'auction_closing_time': 1774884579.0}
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL44785') HTTP/1.1" 204 0
2026-03-28 09:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035
2026-03-28 09:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035
2026-03-28 09:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035 to the API
2026-03-28 09:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_c62e4ca2a72272b15610061cd2cda452.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'petrol',
 'id': 'a8e3ceca-7eaa-5a05-bed5-5875453c8639',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP90035',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 97132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_fa38d1497d5fc1c9f541df692baa9837.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_4c51c1404c0d1beaef68d87ffaeb7ca1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_89808314fc40e13c229ad7c362971cb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_70879cc066e0273ef3d592a2d6b0f7f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_25c530d217430df7e89e1d336c09088b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8e3ceca-7eaa-5a05-bed5-5875453c8639/a8e3ceca-7eaa-5a05-bed5-5875453c8639_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/5c/385c8c3670bb27337156a20ba1a3efb3/pa/AP90035_c62e4ca2a72272b15610061cd2cda452.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2010}
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP90035%27 HTTP/1.1" 200 None
2026-03-28 09:05:55 [auto1.it] INFO: Saving data for AP90035: {'created_time': 1774688755.153839, 'last_price_update_time': 1774688755.153849, 'auction_closing_time': 1774884339.0}
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AP90035') HTTP/1.1" 204 0
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9e0bda57553e4a3f7339cd790f8c59fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_473216cb1e99f18af4f4628c91c98226.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_addb8c2d2ec624c8a002c492a115a286.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_ad3f5dfabc7c092e62b50a096a98f89e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_beba3bc525f7015496d95a17a1422b19.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_43fd07ae0e739b5c43215da814f1e623.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061fcb50>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_8320f596a7b69724d1b33dfe84216fed.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_8320f596a7b69724d1b33dfe84216fed.jpg saved to cache
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066030d0>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_55ad760abd825eaafe150fd3edf6c54e.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55ad760abd825eaafe150fd3edf6c54e.jpg saved to cache
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c274910>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_5cae0a90fa437f6d44602fdd59009a37.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_5cae0a90fa437f6d44602fdd59009a37.jpg saved to cache
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_a77af68a3afc7953af2614890c38650a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_4aa4c317069ddd22d9c3095c6fe0f12f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_29c16a87c4ae571aeb5d4f00848134e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c296250>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_9e0bda57553e4a3f7339cd790f8c59fc.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9e0bda57553e4a3f7339cd790f8c59fc.jpg saved to cache
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0c40d0>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_473216cb1e99f18af4f4628c91c98226.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_473216cb1e99f18af4f4628c91c98226.jpg saved to cache
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06602bd0>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F6e%252F5e6e845a93b9c9e4f850badde89cdde6%252Fpa%252FBY89134_addb8c2d2ec624c8a002c492a115a286.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_addb8c2d2ec624c8a002c492a115a286.jpg saved to cache
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc71848a-b641-55d6-a77a-76af8789aad2
2026-03-28 09:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc71848a-b641-55d6-a77a-76af8789aad2, skipping ID generation
2026-03-28 09:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc71848a-b641-55d6-a77a-76af8789aad2 with scrape type 1
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc71848a-b641-55d6-a77a-76af8789aad2 sending to next pipeline
2026-03-28 09:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc71848a-b641-55d6-a77a-76af8789aad2, identifier: BY89134
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066e9f50>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_ad3f5dfabc7c092e62b50a096a98f89e.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_ad3f5dfabc7c092e62b50a096a98f89e.jpg saved to cache
2026-03-28 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1c1350>
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_beba3bc525f7015496d95a17a1422b19.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_beba3bc525f7015496d95a17a1422b19.jpg saved to cache
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d8b3b90>
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_43fd07ae0e739b5c43215da814f1e623.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_43fd07ae0e739b5c43215da814f1e623.jpg saved to cache
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134
2026-03-28 09:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134
2026-03-28 09:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134 to the API
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_addb8c2d2ec624c8a002c492a115a286.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:45:05Z',
 'fuel_type': 'petrol',
 'id': 'fc71848a-b641-55d6-a77a-76af8789aad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY89134',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 169114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_044d6a11ec3350aa4fc9d0ab4506c53d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_addb8c2d2ec624c8a002c492a115a286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_3e5330dd59be568514bc6dac897a12c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24642,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_bb0842ee31a747a348d55185e77d6882.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc71848a-b641-55d6-a77a-76af8789aad2/fc71848a-b641-55d6-a77a-76af8789aad2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/6e/5e6e845a93b9c9e4f850badde89cdde6/pa/BY89134_9ae293943ebcbdd9e57ac46fb8dcdd1d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY89134%27 HTTP/1.1" 200 None
2026-03-28 09:05:56 [auto1.it] INFO: Saving data for BY89134: {'created_time': 1774688756.415035, 'last_price_update_time': 1774688756.415045, 'auction_closing_time': 1774885505.0}
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY89134') HTTP/1.1" 204 0
2026-03-28 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_ca109eaac1797a228125b74183983406.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_359091951d3f5854f67718c7a15314d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_3aa727b7b782958bfd15af051fbbfc14.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1201d0>
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fed%252F43ed622ed781907c43f707993098b6fb%252Fpa%252FMU21056_a77af68a3afc7953af2614890c38650a.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_a77af68a3afc7953af2614890c38650a.jpg saved to cache
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e64bdd1b-2b2c-560e-97c7-c114510cb31e
2026-03-28 09:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e64bdd1b-2b2c-560e-97c7-c114510cb31e, skipping ID generation
2026-03-28 09:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64bdd1b-2b2c-560e-97c7-c114510cb31e with scrape type 1
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e64bdd1b-2b2c-560e-97c7-c114510cb31e sending to next pipeline
2026-03-28 09:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e64bdd1b-2b2c-560e-97c7-c114510cb31e, identifier: MU21056
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06523050>
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F49%252F7a49613598d19cfb27561ea1174e3593%252Fpa%252FTU55073_4aa4c317069ddd22d9c3095c6fe0f12f.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_4aa4c317069ddd22d9c3095c6fe0f12f.jpg saved to cache
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1bcde52-4b02-5e6c-93e8-ace40d504d49
2026-03-28 09:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1bcde52-4b02-5e6c-93e8-ace40d504d49, skipping ID generation
2026-03-28 09:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bcde52-4b02-5e6c-93e8-ace40d504d49 with scrape type 1
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1bcde52-4b02-5e6c-93e8-ace40d504d49 sending to next pipeline
2026-03-28 09:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1bcde52-4b02-5e6c-93e8-ace40d504d49, identifier: TU55073
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065b8d90>
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_29c16a87c4ae571aeb5d4f00848134e6.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_29c16a87c4ae571aeb5d4f00848134e6.jpg saved to cache
2026-03-28 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d
2026-03-28 09:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056
2026-03-28 09:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056
2026-03-28 09:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056 to the API
2026-03-28 09:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_a77af68a3afc7953af2614890c38650a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:47:35Z',
 'fuel_type': 'diesel',
 'id': 'e64bdd1b-2b2c-560e-97c7-c114510cb31e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU21056',
 'listing': 'auction',
 'location': 'IT, Arezzo',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 130482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_beb59f8862a5bbf4e64d9ceadcdd641e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2356872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_a77af68a3afc7953af2614890c38650a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2198054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_ccca67e9f7da89eb6df3886e2ff72056.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55daadd2de493945bef2d1165e36363e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2383711,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_66458fccf3fdb90812dc45302f403d31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_554926fa1562783f60200a009451b1b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325338,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_8320f596a7b69724d1b33dfe84216fed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2422755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_55ad760abd825eaafe150fd3edf6c54e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_def39d2b3ca4cb0e73576ce86186ed91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64bdd1b-2b2c-560e-97c7-c114510cb31e/e64bdd1b-2b2c-560e-97c7-c114510cb31e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490034,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ed/43ed622ed781907c43f707993098b6fb/pa/MU21056_5cae0a90fa437f6d44602fdd59009a37.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra GTC 2.0 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2012}
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU21056%27 HTTP/1.1" 200 None
2026-03-28 09:05:57 [auto1.it] INFO: Saving data for MU21056: {'created_time': 1774688757.351073, 'last_price_update_time': 1774688757.351083, 'auction_closing_time': 1774885655.0}
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU21056') HTTP/1.1" 204 0
2026-03-28 09:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073
2026-03-28 09:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073
2026-03-28 09:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073 to the API
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_4aa4c317069ddd22d9c3095c6fe0f12f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:34:46Z',
 'fuel_type': 'diesel',
 'id': 'c1bcde52-4b02-5e6c-93e8-ace40d504d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU55073',
 'listing': 'auction',
 'location': 'IT, Agliana (PT)',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 97297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_4aa4c317069ddd22d9c3095c6fe0f12f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_ad3f5dfabc7c092e62b50a096a98f89e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_0c876f349b9be9a7d97c297117d58ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_d368b99f375832c3dd6bf25486fd122f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a0d4e82806c1c99b242d114f4f6129bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_df307dafe4456bf71406cb3807798520.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_51d3c76ee57c65ef9637abc442431d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_a791a2b994254e50f6bb8da7671e28ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_5427a68bb735f3999c8eaa9d8fea5d25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1bcde52-4b02-5e6c-93e8-ace40d504d49/c1bcde52-4b02-5e6c-93e8-ace40d504d49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/49/7a49613598d19cfb27561ea1174e3593/pa/TU55073_e8dde57f96ad474de69cacfd6d9d0567.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2019}
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU55073%27 HTTP/1.1" 200 None
2026-03-28 09:05:57 [auto1.it] INFO: Saving data for TU55073: {'created_time': 1774688757.750703, 'last_price_update_time': 1774688757.750712, 'auction_closing_time': 1774884886.0}
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU55073') HTTP/1.1" 204 0
2026-03-28 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_628365842fea76d22ab7d34a242075e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_a7e90131ea0740b867b5995aacdb261a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_9a29287aff608d56e5c66a46517c68e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_a407dcbe836e9ad12559e9a002f4f2c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c1b779dd0>
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_ca109eaac1797a228125b74183983406.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_ca109eaac1797a228125b74183983406.jpg saved to cache
2026-03-28 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06716a90>
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e08b2de2fd0d1f12d355c092192149a%252Fpa%252FJC52693_359091951d3f5854f67718c7a15314d4.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_359091951d3f5854f67718c7a15314d4.jpg saved to cache
2026-03-28 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2
2026-03-28 09:05:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2, skipping ID generation
2026-03-28 09:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with scrape type 1
2026-03-28 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 sending to next pipeline
2026-03-28 09:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2, identifier: JC52693
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067f6410>
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F21%252F42213882977fe07bba8462806cdb5d8b%252Fpa%252FJB83443_3aa727b7b782958bfd15af051fbbfc14.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_3aa727b7b782958bfd15af051fbbfc14.jpg saved to cache
2026-03-28 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5ad9e16-76e0-5254-8d06-518ec655d30e
2026-03-28 09:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5ad9e16-76e0-5254-8d06-518ec655d30e, skipping ID generation
2026-03-28 09:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ad9e16-76e0-5254-8d06-518ec655d30e with scrape type 1
2026-03-28 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5ad9e16-76e0-5254-8d06-518ec655d30e sending to next pipeline
2026-03-28 09:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5ad9e16-76e0-5254-8d06-518ec655d30e, identifier: JB83443
2026-03-28 09:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693
2026-03-28 09:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693
2026-03-28 09:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693 to the API
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_359091951d3f5854f67718c7a15314d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:13:57Z',
 'fuel_type': 'diesel',
 'id': '3c7aae4a-a871-5e31-92c9-5c95d73d67d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC52693',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 122134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_359091951d3f5854f67718c7a15314d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_43fd07ae0e739b5c43215da814f1e623.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_58f1b95d1e9f53094182e85c25b3099e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_f5d59a3309c18396196f4aca3646e28d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_56a44cffade0459784b34f892eb466fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_a329c43349ce8de1d3944c43fd67f7f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_eeb7fc97f127cbb72c299f5e77afe884.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_cc14d9d37e7de2aaed4cb871c0c701af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_86c3ad852cc123aeddd7cb362cd4686e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7aae4a-a871-5e31-92c9-5c95d73d67d2/3c7aae4a-a871-5e31-92c9-5c95d73d67d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e08b2de2fd0d1f12d355c092192149a/pa/JC52693_3cfa0fc580d3858e0afec3963f65ccb8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2020}
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC52693%27 HTTP/1.1" 200 None
2026-03-28 09:05:58 [auto1.it] INFO: Saving data for JC52693: {'created_time': 1774688758.489787, 'last_price_update_time': 1774688758.489796, 'auction_closing_time': 1774883637.0}
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC52693') HTTP/1.1" 204 0
2026-03-28 09:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443
2026-03-28 09:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443
2026-03-28 09:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443 to the API
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_3aa727b7b782958bfd15af051fbbfc14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:15Z',
 'fuel_type': 'diesel',
 'id': 'f5ad9e16-76e0-5254-8d06-518ec655d30e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB83443',
 'listing': 'auction',
 'location': 'IT, Fiumicino',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 187922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_3aa727b7b782958bfd15af051fbbfc14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_473216cb1e99f18af4f4628c91c98226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_73c1990b173c2d18a03c8ed2a494a0fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_a25452230887f94891b1591d6fe4c1e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_29175d74c6638590d590fcc5937aaf98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_cfc38f2b077c04af5d94c68ed47fbae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_c659332e5a46fef1062714da9a4bc5d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_bafcbf4ed88e532f0b7e8cf0c4f62ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_d43cf1c5e75d928367a1eb8e342e94da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ad9e16-76e0-5254-8d06-518ec655d30e/f5ad9e16-76e0-5254-8d06-518ec655d30e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/21/42213882977fe07bba8462806cdb5d8b/pa/JB83443_2868c39b0732c0200760209fa1c4c6ed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Technofeel',
 'transmission': 'manual',
 'trim': 'Technofeel',
 'year': 2014}
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83443%27 HTTP/1.1" 200 None
2026-03-28 09:05:58 [auto1.it] INFO: Saving data for JB83443: {'created_time': 1774688758.887179, 'last_price_update_time': 1774688758.887188, 'auction_closing_time': 1774885875.0}
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB83443') HTTP/1.1" 204 0
2026-03-28 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_785a43e285efb10470b396d5b9f4fd30.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_11ff463a1f73be04280e65591c504ace.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD04886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU59167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV63380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE70672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065d35d0>
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_628365842fea76d22ab7d34a242075e1.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_628365842fea76d22ab7d34a242075e1.jpg saved to cache
2026-03-28 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c270850>
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_a7e90131ea0740b867b5995aacdb261a.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_a7e90131ea0740b867b5995aacdb261a.jpg saved to cache
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c31b190>
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_9a29287aff608d56e5c66a46517c68e1.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_9a29287aff608d56e5c66a46517c68e1.jpg saved to cache
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2c7850>
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9c%252F9b9c2229a38802e4a0e781c94ccc5dcd%252Fpa%252FFC17573_a407dcbe836e9ad12559e9a002f4f2c1.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_a407dcbe836e9ad12559e9a002f4f2c1.jpg saved to cache
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d
2026-03-28 09:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d, skipping ID generation
2026-03-28 09:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d with scrape type 1
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d sending to next pipeline
2026-03-28 09:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d, identifier: FC17573
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_0184fd15cb98debc49670b39dba5900d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d with identifier: FC17573
2026-03-28 09:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d with identifier: FC17573
2026-03-28 09:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d with identifier: FC17573 to the API
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_a407dcbe836e9ad12559e9a002f4f2c1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:22:57Z',
 'fuel_type': 'diesel',
 'id': '8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC17573',
 'listing': 'auction',
 'location': 'IT, Avezzano',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 199945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_a407dcbe836e9ad12559e9a002f4f2c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_628365842fea76d22ab7d34a242075e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_29c16a87c4ae571aeb5d4f00848134e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_7d5b536613da049db9992027b5c562b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d/8e14a5fb-8e58-546d-9cf5-5c8f1a858a4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9c/9b9c2229a38802e4a0e781c94ccc5dcd/pa/FC17573_c8aa81555746c9b96ee25f0bb1fe89a2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.3 JTD Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2011}
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC17573%27 HTTP/1.1" 200 None
2026-03-28 09:05:59 [auto1.it] INFO: Saving data for FC17573: {'created_time': 1774688759.586231, 'last_price_update_time': 1774688759.586241, 'auction_closing_time': 1774884177.0}
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FC17573') HTTP/1.1" 204 0
2026-03-28 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cfce690f254396eb1831e8e96347f150.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_dd64612f3e7cd2b58cd4bb9be04457a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_45186906cd7db9d5def4574d2e083007.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU26591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK26905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_9ecc805bc1f0bc464ee7862c3615d6eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066037d0>
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_785a43e285efb10470b396d5b9f4fd30.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_785a43e285efb10470b396d5b9f4fd30.jpg saved to cache
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1c2850>
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_11ff463a1f73be04280e65591c504ace.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_11ff463a1f73be04280e65591c504ace.jpg saved to cache
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06715250>
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_0184fd15cb98debc49670b39dba5900d.jpg') HTTP/1.1" 204 0
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_0184fd15cb98debc49670b39dba5900d.jpg saved to cache
2026-03-28 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_270580f16bb13f61ca0d9820a0a88150.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_52a92f386d07fa4744ca194ee9243dd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0c51d0>
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F42%252Fca42d9e9883b7141fa854a601458c6c8%252Fpa%252FRU74019_cfce690f254396eb1831e8e96347f150.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cfce690f254396eb1831e8e96347f150.jpg saved to cache
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb
2026-03-28 09:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb, skipping ID generation
2026-03-28 09:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with scrape type 1
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb sending to next pipeline
2026-03-28 09:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb, identifier: RU74019
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06600390>
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_dd64612f3e7cd2b58cd4bb9be04457a3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_dd64612f3e7cd2b58cd4bb9be04457a3.jpg saved to cache
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0c6c90>
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_45186906cd7db9d5def4574d2e083007.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_45186906cd7db9d5def4574d2e083007.jpg saved to cache
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c29c510>
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_9ecc805bc1f0bc464ee7862c3615d6eb.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_9ecc805bc1f0bc464ee7862c3615d6eb.jpg saved to cache
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 09:06:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019
2026-03-28 09:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019 to the API
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cfce690f254396eb1831e8e96347f150.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:16:58Z',
 'fuel_type': 'petrol',
 'id': '3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU74019',
 'listing': 'auction',
 'location': 'IT, Catanzaro CZ',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 150498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_a8939741bc158772792ffce4a620a1c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cf6c0cb906e229c5d7c8385d9752ef1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9571394092d8ba228d09f9ce0e5c4fe8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_f3d0f9ff53dc03ed2c52d3330358b19b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_8e4b7af1d1cdda6afc75fd97c9b6fce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_beba3bc525f7015496d95a17a1422b19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_81c62d3b657604d0f6d95c9a89895ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998507,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_cfce690f254396eb1831e8e96347f150.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_9e0bda57553e4a3f7339cd790f8c59fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb/3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/42/ca42d9e9883b7141fa854a601458c6c8/pa/RU74019_dc4f4a237fcd7c2952ad85e456e54596.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active Collection',
 'transmission': 'manual',
 'trim': 'Active Collection',
 'year': 2016}
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU74019%27 HTTP/1.1" 200 None
2026-03-28 09:06:00 [auto1.it] INFO: Saving data for RU74019: {'created_time': 1774688760.770734, 'last_price_update_time': 1774688760.770746, 'auction_closing_time': 1774883818.0}
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU74019') HTTP/1.1" 204 0
2026-03-28 09:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_4a52346c467ffbb7928a100254963353.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE94474> (referer: https://www.auto1.com/v1/car-details-view/UE94474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c193850>
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_270580f16bb13f61ca0d9820a0a88150.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_270580f16bb13f61ca0d9820a0a88150.jpg saved to cache
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c109690>
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_52a92f386d07fa4744ca194ee9243dd2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_52a92f386d07fa4744ca194ee9243dd2.jpg saved to cache
2026-03-28 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0673ab10>
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F72%252F3d72979d1d966d561a9f9a9bca4bf199%252Fpa%252FNY06096_4a52346c467ffbb7928a100254963353.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_4a52346c467ffbb7928a100254963353.jpg saved to cache
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a67c0962-2149-53ef-89ab-d2dd2dc55dea
2026-03-28 09:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a67c0962-2149-53ef-89ab-d2dd2dc55dea, skipping ID generation
2026-03-28 09:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67c0962-2149-53ef-89ab-d2dd2dc55dea with scrape type 1
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a67c0962-2149-53ef-89ab-d2dd2dc55dea sending to next pipeline
2026-03-28 09:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a67c0962-2149-53ef-89ab-d2dd2dc55dea, identifier: NY06096
2026-03-28 09:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474
2026-03-28 09:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348d1838-f3b3-5602-b58c-d387a09af876 with scrape type 1
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_ff5d140af868b505be40f22002a63350.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ff5d140af868b505be40f22002a63350.jpg not downloaded yet
2026-03-28 09:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096
2026-03-28 09:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096
2026-03-28 09:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096 to the API
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_4a52346c467ffbb7928a100254963353.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:48Z',
 'fuel_type': 'diesel',
 'id': 'a67c0962-2149-53ef-89ab-d2dd2dc55dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY06096',
 'listing': 'auction',
 'location': 'IT, Mantova',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 158079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_8f256f08ddd37638aa1f65ca67598516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357893,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_4a52346c467ffbb7928a100254963353.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354825,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_52a92f386d07fa4744ca194ee9243dd2.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_dd64612f3e7cd2b58cd4bb9be04457a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376699,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_9ecc805bc1f0bc464ee7862c3615d6eb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340093,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_5f84bc69dc668271b79c7c94cd2197cf.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260122,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_d099f6910cdbd0e3451cc5cf67076597.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378937,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_0184fd15cb98debc49670b39dba5900d.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_7e54bbd88fe349813f36a92681d83c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67c0962-2149-53ef-89ab-d2dd2dc55dea/a67c0962-2149-53ef-89ab-d2dd2dc55dea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302993,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/72/3d72979d1d966d561a9f9a9bca4bf199/pa/NY06096_785a43e285efb10470b396d5b9f4fd30.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2016}
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY06096%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [auto1.it] INFO: Saving data for NY06096: {'created_time': 1774688761.4965, 'last_price_update_time': 1774688761.496511, 'auction_closing_time': 1774884528.0}
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY06096') HTTP/1.1" 204 0
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_0fd89412cf8570dcb698c80a19937edb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0fd89412cf8570dcb698c80a19937edb.jpg not downloaded yet
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_ae4d7e73da3447a8ef21640c16ee6df3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ae4d7e73da3447a8ef21640c16ee6df3.jpg not downloaded yet
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR71782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC15950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW36660> (referer: https://www.auto1.com/v1/car-details-view/HW36660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN63848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC40082/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_f4832ae067bd6155d408d5836f4e2b41.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_f4832ae067bd6155d408d5836f4e2b41.jpg not downloaded yet
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_bdf7a84cb5e933a0d4201b1e76ac99d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_bdf7a84cb5e933a0d4201b1e76ac99d9.jpg not downloaded yet
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_0a8e205748dfd58d44cfc47715a8d6d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0a8e205748dfd58d44cfc47715a8d6d7.jpg not downloaded yet
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_727df96f7bf31ddbc83da1ade48be85e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_727df96f7bf31ddbc83da1ade48be85e.jpg not downloaded yet
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_85ec8138f7393a6c386d3d44d55a8a11.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_045379d06b845b3d431e98fca80ef960.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_045379d06b845b3d431e98fca80ef960.jpg not downloaded yet
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ff5d140af868b505be40f22002a63350.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_ceee493f3c96df2f90d3bb148bd56fee.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ceee493f3c96df2f90d3bb148bd56fee.jpg not downloaded yet
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_c29821132c73bbe2be65611716d37fa4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_c29821132c73bbe2be65611716d37fa4.jpg not downloaded yet
2026-03-28 09:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660
2026-03-28 09:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with scrape type 1
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_48de816cf3f9a7dfa6dc622df671595a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_48de816cf3f9a7dfa6dc622df671595a.jpg not downloaded yet
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_458320b2f3677d709082541b50643074.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_458320b2f3677d709082541b50643074.jpg not downloaded yet
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_a41b31fb7a23e3c26edec5f3fc3e9675.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_a41b31fb7a23e3c26edec5f3fc3e9675.jpg not downloaded yet
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d16301fff5df3e90e8a5c56f82f8defa.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06574290>
2026-03-28 09:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8c%252Fef8cb8082b9feb48c9892eff954b1334%252Fpa%252FDD11193_85ec8138f7393a6c386d3d44d55a8a11.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_85ec8138f7393a6c386d3d44d55a8a11.jpg saved to cache
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba7ed83d-5a68-53a2-9d12-f933046502c2
2026-03-28 09:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba7ed83d-5a68-53a2-9d12-f933046502c2, skipping ID generation
2026-03-28 09:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba7ed83d-5a68-53a2-9d12-f933046502c2 with scrape type 1
2026-03-28 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba7ed83d-5a68-53a2-9d12-f933046502c2 sending to next pipeline
2026-03-28 09:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba7ed83d-5a68-53a2-9d12-f933046502c2, identifier: DD11193
2026-03-28 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_0ebe23f8d4f05ef75ebc050ebebaa55c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_02bc3b630d413b6b3170fdabe3fbcb57.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_02bc3b630d413b6b3170fdabe3fbcb57.jpg not downloaded yet
2026-03-28 09:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193
2026-03-28 09:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193
2026-03-28 09:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193 to the API
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_85ec8138f7393a6c386d3d44d55a8a11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:04:16Z',
 'fuel_type': 'petrol',
 'id': 'ba7ed83d-5a68-53a2-9d12-f933046502c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD11193',
 'listing': 'auction',
 'location': 'IT, Legnano',
 'make': 'Toyota',
 'model': 'iQ',
 'odometer': 46737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481208,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_85ec8138f7393a6c386d3d44d55a8a11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_ca109eaac1797a228125b74183983406.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_5c627c1d909b66d1e299d3b94ae338c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_8bf33bd2636466d220f8992979669f8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2210676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_0a3d77209138b40da1c1de55f6b554e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a346da124a601c89b807b62f030282ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_7c81b8e5bfcf22251e45fd16603f5007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_a1c6f95add5eb2feb3ed0a2eb7c430d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_50b335e09262b356586408848009ea59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7ed83d-5a68-53a2-9d12-f933046502c2/ba7ed83d-5a68-53a2-9d12-f933046502c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8c/ef8cb8082b9feb48c9892eff954b1334/pa/DD11193_4ebfa2b1ff6e4548b685806ef036d635.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota iQ 1.0 VVT-i Sol',
 'transmission': 'automatic',
 'trim': 'Sol',
 'year': 2014}
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD11193%27 HTTP/1.1" 200 None
2026-03-28 09:06:02 [auto1.it] INFO: Saving data for DD11193: {'created_time': 1774688762.488148, 'last_price_update_time': 1774688762.488195, 'auction_closing_time': 1774883056.0}
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD11193') HTTP/1.1" 204 0
2026-03-28 09:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0fd89412cf8570dcb698c80a19937edb.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0a8e205748dfd58d44cfc47715a8d6d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_045379d06b845b3d431e98fca80ef960.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_482e88bfaa57d48866f064f2861baf57.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_482e88bfaa57d48866f064f2861baf57.jpg not downloaded yet
2026-03-28 09:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX70685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2e5710>
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_ff5d140af868b505be40f22002a63350.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ff5d140af868b505be40f22002a63350.jpg saved to cache
2026-03-28 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c24a290>
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5f%252Fa85fccb60838feed452d89dc4b3a1898%252Fpa%252FBU89130_d16301fff5df3e90e8a5c56f82f8defa.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d16301fff5df3e90e8a5c56f82f8defa.jpg saved to cache
2026-03-28 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3631ea6d-4553-5fb3-b183-983c0ed9560b
2026-03-28 09:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3631ea6d-4553-5fb3-b183-983c0ed9560b, skipping ID generation
2026-03-28 09:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3631ea6d-4553-5fb3-b183-983c0ed9560b with scrape type 1
2026-03-28 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3631ea6d-4553-5fb3-b183-983c0ed9560b sending to next pipeline
2026-03-28 09:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3631ea6d-4553-5fb3-b183-983c0ed9560b, identifier: BU89130
2026-03-28 09:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG05236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130
2026-03-28 09:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130
2026-03-28 09:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130 to the API
2026-03-28 09:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d16301fff5df3e90e8a5c56f82f8defa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.8L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:19:50Z',
 'fuel_type': 'diesel',
 'id': '3631ea6d-4553-5fb3-b183-983c0ed9560b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU89130',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 168514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2677623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_88171b8e623e2139b072680555314fc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d7a7c4604f72339c4b03f4c6c99182a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539351,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_d16301fff5df3e90e8a5c56f82f8defa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_270580f16bb13f61ca0d9820a0a88150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_45186906cd7db9d5def4574d2e083007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_11ff463a1f73be04280e65591c504ace.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_4bc01316abfe521bee2f1b929bebf3fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_713c549d5c3c542e1bfcbc7a4ece068d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_9a29287aff608d56e5c66a46517c68e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631ea6d-4553-5fb3-b183-983c0ed9560b/3631ea6d-4553-5fb3-b183-983c0ed9560b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5f/a85fccb60838feed452d89dc4b3a1898/pa/BU89130_a7e90131ea0740b867b5995aacdb261a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.8 CRD Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2011}
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU89130%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [auto1.it] INFO: Saving data for BU89130: {'created_time': 1774688763.168112, 'last_price_update_time': 1774688763.168123, 'auction_closing_time': 1774883990.0}
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BU89130') HTTP/1.1" 204 0
2026-03-28 09:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c217090>
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_0ebe23f8d4f05ef75ebc050ebebaa55c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_0ebe23f8d4f05ef75ebc050ebebaa55c.jpg saved to cache
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB28979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV63380> (referer: https://www.auto1.com/v1/car-details-view/RV63380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066ed850>
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_0fd89412cf8570dcb698c80a19937edb.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0fd89412cf8570dcb698c80a19937edb.jpg saved to cache
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c04db90>
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_0a8e205748dfd58d44cfc47715a8d6d7.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0a8e205748dfd58d44cfc47715a8d6d7.jpg saved to cache
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06544ad0>
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_045379d06b845b3d431e98fca80ef960.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_045379d06b845b3d431e98fca80ef960.jpg saved to cache
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380
2026-03-28 09:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with scrape type 1
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_fc0aef680c50fe3f13075c3addd36dd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_fc0aef680c50fe3f13075c3addd36dd5.jpg not downloaded yet
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_bccaa4d5baedbe1ff2849f5328ce3546.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_bccaa4d5baedbe1ff2849f5328ce3546.jpg not downloaded yet
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_48de816cf3f9a7dfa6dc622df671595a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_a41b31fb7a23e3c26edec5f3fc3e9675.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_3782588d9eabf8f68010ff50a87d06a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_3782588d9eabf8f68010ff50a87d06a3.jpg not downloaded yet
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_482e88bfaa57d48866f064f2861baf57.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK26905> (referer: https://www.auto1.com/v1/car-details-view/NK26905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_02bc3b630d413b6b3170fdabe3fbcb57.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_a85eb8c229344cc3acbba1a32a75ff2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_a85eb8c229344cc3acbba1a32a75ff2f.jpg not downloaded yet
2026-03-28 09:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE70672> (referer: https://www.auto1.com/v1/car-details-view/JE70672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:03 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_458320b2f3677d709082541b50643074.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_66088c9491630ed52b1e0efa63c25f8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_66088c9491630ed52b1e0efa63c25f8d.jpg not downloaded yet
2026-03-28 09:06:03 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP64063%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [auto1.it] INFO: Scrape type for EP64063: 1
2026-03-28 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_fc0aef680c50fe3f13075c3addd36dd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:03 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-28 09:06:03 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98022%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [auto1.it] INFO: Scrape type for DP98022: 1
2026-03-28 09:06:03 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ57511%27 HTTP/1.1" 200 None
2026-03-28 09:06:03 [auto1.it] INFO: Scrape type for TZ57511: 2
2026-03-28 09:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511
2026-03-28 09:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6488b779-3c9a-5a52-b6b9-f456660da4e0 with scrape type 2
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6488b779-3c9a-5a52-b6b9-f456660da4e0 with scrape type 2
2026-03-28 09:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6488b779-3c9a-5a52-b6b9-f456660da4e0, identifier: TZ57511
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d8c7910>
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_48de816cf3f9a7dfa6dc622df671595a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_48de816cf3f9a7dfa6dc622df671595a.jpg saved to cache
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c08b0d0>
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_a41b31fb7a23e3c26edec5f3fc3e9675.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_a41b31fb7a23e3c26edec5f3fc3e9675.jpg saved to cache
2026-03-28 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5
2026-03-28 09:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511
2026-03-28 09:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511
2026-03-28 09:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511 to the API
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:59:02Z',
 'fuel_type': 'diesel',
 'id': '6488b779-3c9a-5a52-b6b9-f456660da4e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ57511',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 145018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-10',
 'seller_name': None,
 'title': 'Jeep Compass 2.2 CRD Sport 4x2',
 'transmission': 'manual',
 'trim': 'Sport 4x2',
 'year': 2012}
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ57511%27 HTTP/1.1" 200 None
2026-03-28 09:06:04 [auto1.it] INFO: Saving data for TZ57511: {'auction_closing_time': 1774886342.0, 'created_time': 1774343139.889664, 'last_price_update_time': 1774688764.069831}
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ57511') HTTP/1.1" 204 0
2026-03-28 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_c29821132c73bbe2be65611716d37fa4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_a85eb8c229344cc3acbba1a32a75ff2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:04 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75286%27 HTTP/1.1" 200 None
2026-03-28 09:06:04 [auto1.it] INFO: Scrape type for XF75286: 2
2026-03-28 09:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286
2026-03-28 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with scrape type 2
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with scrape type 2
2026-03-28 09:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b, identifier: XF75286
2026-03-28 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_bccaa4d5baedbe1ff2849f5328ce3546.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_3782588d9eabf8f68010ff50a87d06a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286
2026-03-28 09:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286
2026-03-28 09:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286 to the API
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:20Z',
 'fuel_type': 'diesel',
 'id': '16b65cd5-acdf-5d0b-8741-13bc0ab20a7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF75286',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 174415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-27',
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion Tech',
 'year': 2018}
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75286%27 HTTP/1.1" 200 None
2026-03-28 09:06:04 [auto1.it] INFO: Saving data for XF75286: {'auction_closing_time': 1774884320.0, 'created_time': 1774447596.014384, 'last_price_update_time': 1774688764.521356}
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF75286') HTTP/1.1" 204 0
2026-03-28 09:06:04 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-28 09:06:04 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD21144%27 HTTP/1.1" 200 None
2026-03-28 09:06:04 [auto1.it] INFO: Scrape type for YD21144: 2
2026-03-28 09:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144
2026-03-28 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5aab5b-d54b-5932-92d3-70e5eefa8263 with scrape type 2
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5aab5b-d54b-5932-92d3-70e5eefa8263 with scrape type 2
2026-03-28 09:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf5aab5b-d54b-5932-92d3-70e5eefa8263, identifier: YD21144
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2c5850>
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_482e88bfaa57d48866f064f2861baf57.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_482e88bfaa57d48866f064f2861baf57.jpg saved to cache
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5
2026-03-28 09:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905
2026-03-28 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with scrape type 1
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_fe66eb89a7b9ba7db8d18a39f753de55.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_fe66eb89a7b9ba7db8d18a39f753de55.jpg not downloaded yet
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061ea850>
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_02bc3b630d413b6b3170fdabe3fbcb57.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_02bc3b630d413b6b3170fdabe3fbcb57.jpg saved to cache
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5
2026-03-28 09:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672
2026-03-28 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0201274d-d103-5b9f-b47f-a2350e121c7b with scrape type 1
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_b91159808c65dd106e40987697a9fbce.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_b91159808c65dd106e40987697a9fbce.jpg not downloaded yet
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c758150>
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F1a%252F431ae379b42737fb355773a4b2753310%252Fpa%252FHW36660_458320b2f3677d709082541b50643074.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_458320b2f3677d709082541b50643074.jpg saved to cache
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5
2026-03-28 09:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dd0c6c7-5039-595b-9212-3784bd7d10b5, skipping ID generation
2026-03-28 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with scrape type 1
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5 sending to next pipeline
2026-03-28 09:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2dd0c6c7-5039-595b-9212-3784bd7d10b5, identifier: HW36660
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0652edd0>
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_fc0aef680c50fe3f13075c3addd36dd5.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_fc0aef680c50fe3f13075c3addd36dd5.jpg saved to cache
2026-03-28 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4
2026-03-28 09:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144
2026-03-28 09:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144
2026-03-28 09:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144 to the API
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:39:15Z',
 'fuel_type': 'diesel',
 'id': 'bf5aab5b-d54b-5932-92d3-70e5eefa8263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD21144',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 155349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD21144%27 HTTP/1.1" 200 None
2026-03-28 09:06:05 [auto1.it] INFO: Saving data for YD21144: {'auction_closing_time': 1774885155.0, 'created_time': 1773130267.263325, 'last_price_update_time': 1774688765.31118}
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD21144') HTTP/1.1" 204 0
2026-03-28 09:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660
2026-03-28 09:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660
2026-03-28 09:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660 to the API
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_458320b2f3677d709082541b50643074.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:33:29Z',
 'fuel_type': 'diesel',
 'id': '2dd0c6c7-5039-595b-9212-3784bd7d10b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW36660',
 'listing': 'auction',
 'location': 'IT, Ladispoli',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 221716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_48de816cf3f9a7dfa6dc622df671595a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_458320b2f3677d709082541b50643074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_a41b31fb7a23e3c26edec5f3fc3e9675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_02bc3b630d413b6b3170fdabe3fbcb57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd0c6c7-5039-595b-9212-3784bd7d10b5/2dd0c6c7-5039-595b-9212-3784bd7d10b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/1a/431ae379b42737fb355773a4b2753310/pa/HW36660_482e88bfaa57d48866f064f2861baf57.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Delta 1.6 Diesel Oro',
 'transmission': 'automatic',
 'trim': 'Oro',
 'year': 2013}
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW36660%27 HTTP/1.1" 200 None
2026-03-28 09:06:05 [auto1.it] INFO: Saving data for HW36660: {'created_time': 1774688765.683369, 'last_price_update_time': 1774688765.683381, 'auction_closing_time': 1774884809.0}
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW36660') HTTP/1.1" 204 0
2026-03-28 09:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_66088c9491630ed52b1e0efa63c25f8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:05 [scrapy.extensions.logstats] INFO: Crawled 74 pages (at 74 pages/min), scraped 29 items (at 29 items/min)
2026-03-28 09:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 186MiB
2026-03-28 09:06:05 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-28 09:06:05 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC99655%27 HTTP/1.1" 200 None
2026-03-28 09:06:05 [auto1.it] INFO: Scrape type for JC99655: 1
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_3824e0245a7ddc29d79c0e5fd5f1bef5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_3824e0245a7ddc29d79c0e5fd5f1bef5.jpg not downloaded yet
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_9e49e07815a24d31c17b22a3b0eaa63e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9e49e07815a24d31c17b22a3b0eaa63e.jpg not downloaded yet
2026-03-28 09:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD04886> (referer: https://www.auto1.com/v1/car-details-view/TD04886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU59167> (referer: https://www.auto1.com/v1/car-details-view/TU59167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU26591> (referer: https://www.auto1.com/v1/car-details-view/NU26591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065c2250>
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_c29821132c73bbe2be65611716d37fa4.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_c29821132c73bbe2be65611716d37fa4.jpg saved to cache
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0660d110>
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_a85eb8c229344cc3acbba1a32a75ff2f.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_a85eb8c229344cc3acbba1a32a75ff2f.jpg saved to cache
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067bde50>
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_bccaa4d5baedbe1ff2849f5328ce3546.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_bccaa4d5baedbe1ff2849f5328ce3546.jpg saved to cache
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c31a810>
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_3782588d9eabf8f68010ff50a87d06a3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_3782588d9eabf8f68010ff50a87d06a3.jpg saved to cache
2026-03-28 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4
2026-03-28 09:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:06 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN59096%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [auto1.it] INFO: Scrape type for YN59096: 2
2026-03-28 09:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096
2026-03-28 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with scrape type 2
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with scrape type 2
2026-03-28 09:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf4aafb8-fc4c-5af0-9866-506f8f82ce24, identifier: YN59096
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_5d9cf4913dc1a478dc625d9e4dcccd30.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_5d9cf4913dc1a478dc625d9e4dcccd30.jpg not downloaded yet
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_c4fe16da11123bc43892ece020dc00e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c4fe16da11123bc43892ece020dc00e3.jpg not downloaded yet
2026-03-28 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC40082> (referer: https://www.auto1.com/v1/car-details-view/YC40082/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN63848> (referer: https://www.auto1.com/v1/car-details-view/MN63848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096
2026-03-28 09:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096
2026-03-28 09:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096 to the API
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:00:25Z',
 'fuel_type': 'petrol',
 'id': 'cf4aafb8-fc4c-5af0-9866-506f8f82ce24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN59096',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 88015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-24',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2014}
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN59096%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [auto1.it] INFO: Saving data for YN59096: {'auction_closing_time': 1774882825.0, 'created_time': 1773954876.702786, 'last_price_update_time': 1774688766.487596}
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN59096') HTTP/1.1" 204 0
2026-03-28 09:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061e4f90>
2026-03-28 09:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F05%252F6d05d5d4df8e91bbf0157b1e6787b786%252Fpa%252FRV63380_66088c9491630ed52b1e0efa63c25f8d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_66088c9491630ed52b1e0efa63c25f8d.jpg saved to cache
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4
2026-03-28 09:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6df7a9f-1dab-5409-a138-46e2ab4b07d4, skipping ID generation
2026-03-28 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with scrape type 1
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4 sending to next pipeline
2026-03-28 09:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b6df7a9f-1dab-5409-a138-46e2ab4b07d4, identifier: RV63380
2026-03-28 09:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886
2026-03-28 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc7c546-0122-5029-805b-39cc6c550770 with scrape type 1
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bc7c546-0122-5029-805b-39cc6c550770
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_ce71941907919cceac8df7a08657404e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_ce71941907919cceac8df7a08657404e.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_616542403fc0ed81f851560589cdb38f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_616542403fc0ed81f851560589cdb38f.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_57235469703be36182fb786348a4f4b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_57235469703be36182fb786348a4f4b0.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_bf914f06684e78cf397bbac3d8087d53.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_bf914f06684e78cf397bbac3d8087d53.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_5cd97c96e2254334fe1abf9bd8975a19.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_5cd97c96e2254334fe1abf9bd8975a19.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_e24dc278a31c1312ecaaf8e165b94d90.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_e24dc278a31c1312ecaaf8e165b94d90.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_22fa1d9960d5cef625dd3808fc14515d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_22fa1d9960d5cef625dd3808fc14515d.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_c10a7b739561ae8674847fef2aacad98.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_c10a7b739561ae8674847fef2aacad98.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_1f787ee9dcdf5f40e7e0451f8daa2ba4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_1f787ee9dcdf5f40e7e0451f8daa2ba4.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d8f12bca7c7b4370c2ebc19361cb4%252Fpa%252FTD04886_579f05292145619051cb1a5627e665d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_579f05292145619051cb1a5627e665d1.jpg already downloaded
2026-03-28 09:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6bc7c546-0122-5029-805b-39cc6c550770, identifier: TD04886
2026-03-28 09:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167
2026-03-28 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e9fe25c-0dbe-5298-99f6-7627c7332175 with scrape type 1
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e9fe25c-0dbe-5298-99f6-7627c7332175
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_6d823f27b736e2a253a3b6ec25a3756a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_6d823f27b736e2a253a3b6ec25a3756a.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_5cebe9c945ba17e5bf4b017d6e15e755.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5cebe9c945ba17e5bf4b017d6e15e755.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_e86db4ea0d83953d2532eb33de179a2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_e86db4ea0d83953d2532eb33de179a2e.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_cdee39bc66a5c85e5d5e80354ed2ae62.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_cdee39bc66a5c85e5d5e80354ed2ae62.jpg already downloaded
2026-03-28 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_d1aeae5a03366dfec0e93f26ef9ac72e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_d1aeae5a03366dfec0e93f26ef9ac72e.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_4469369c52252595de86cfc35c7a01c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_4469369c52252595de86cfc35c7a01c7.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_56fc560f355bbe8b3e266721df358562.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_56fc560f355bbe8b3e266721df358562.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_5b010a208559d1183724af8abb4df2a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5b010a208559d1183724af8abb4df2a1.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_5035672e4cae64c7105f96929661e887.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5035672e4cae64c7105f96929661e887.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fdf%252F5fdfb0054558c3074a5929bdc5a458ee%252Fpa%252FTU59167_535bcf291461ff34ba36978d453672fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_535bcf291461ff34ba36978d453672fd.jpg already downloaded
2026-03-28 09:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e9fe25c-0dbe-5298-99f6-7627c7332175, identifier: TU59167
2026-03-28 09:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591
2026-03-28 09:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b064af-bfba-53a2-a199-97b5474b8605 with scrape type 1
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95b064af-bfba-53a2-a199-97b5474b8605
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_f608283ec02eba5c8bb41b4f168bba32.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_f608283ec02eba5c8bb41b4f168bba32.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_ab777c1ca72eddab4a9fb8380ed4efb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_ab777c1ca72eddab4a9fb8380ed4efb8.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_1bec2e0761c1ddfb8034f208ef5e9c67.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_1bec2e0761c1ddfb8034f208ef5e9c67.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_701ab3b198493ee1b3231a0dc8e2e9a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_701ab3b198493ee1b3231a0dc8e2e9a8.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_04b7e93d193d155282ea358bc9437142.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_04b7e93d193d155282ea358bc9437142.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_b3e74d8f7e2ff0424c4e254a82814ba5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_b3e74d8f7e2ff0424c4e254a82814ba5.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_0ac6aa4225b72f4f5fc1be9c5591311b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_0ac6aa4225b72f4f5fc1be9c5591311b.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_7060f5de841bf8169f950b89a19d77be.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_7060f5de841bf8169f950b89a19d77be.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_ab3fa96e73506219e744825f981d05c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_ab3fa96e73506219e744825f981d05c4.jpg already downloaded
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc3%252F8ac3f71a2f63946d05b023e03f692b56%252Fpa%252FNU26591_9900d8a4201b16f0bc75751955fd31a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_9900d8a4201b16f0bc75751955fd31a2.jpg already downloaded
2026-03-28 09:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95b064af-bfba-53a2-a199-97b5474b8605, identifier: NU26591
2026-03-28 09:06:07 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10641%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [auto1.it] INFO: Scrape type for PC10641: 1
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_a10817d8b7a18f26291cc6c7dab55746.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_a10817d8b7a18f26291cc6c7dab55746.jpg not downloaded yet
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_59823ca9e9fb7db12a3ceb3579e22d40.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_59823ca9e9fb7db12a3ceb3579e22d40.jpg not downloaded yet
2026-03-28 09:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380
2026-03-28 09:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380
2026-03-28 09:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380 to the API
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_66088c9491630ed52b1e0efa63c25f8d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:16:32Z',
 'fuel_type': 'petrol',
 'id': 'b6df7a9f-1dab-5409-a138-46e2ab4b07d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV63380',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 140593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_fc0aef680c50fe3f13075c3addd36dd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_bccaa4d5baedbe1ff2849f5328ce3546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_3782588d9eabf8f68010ff50a87d06a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_a85eb8c229344cc3acbba1a32a75ff2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df7a9f-1dab-5409-a138-46e2ab4b07d4/b6df7a9f-1dab-5409-a138-46e2ab4b07d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/05/6d05d5d4df8e91bbf0157b1e6787b786/pa/RV63380_66088c9491630ed52b1e0efa63c25f8d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 Classique',
 'transmission': 'manual',
 'trim': 'Classique',
 'year': 2010}
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV63380%27 HTTP/1.1" 200 None
2026-03-28 09:06:07 [auto1.it] INFO: Saving data for RV63380: {'created_time': 1774688767.88537, 'last_price_update_time': 1774688767.88538, 'auction_closing_time': 1774883792.0}
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV63380') HTTP/1.1" 204 0
2026-03-28 09:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 09:06:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886
2026-03-28 09:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886 to the API
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TD04886>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:41Z',
 'fuel_type': 'diesel',
 'id': '6bc7c546-0122-5029-805b-39cc6c550770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD04886',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'BMW',
 'model': '1er',
 'odometer': 134839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_ce71941907919cceac8df7a08657404e.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_616542403fc0ed81f851560589cdb38f.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_57235469703be36182fb786348a4f4b0.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_bf914f06684e78cf397bbac3d8087d53.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_5cd97c96e2254334fe1abf9bd8975a19.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_e24dc278a31c1312ecaaf8e165b94d90.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_22fa1d9960d5cef625dd3808fc14515d.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_c10a7b739561ae8674847fef2aacad98.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_1f787ee9dcdf5f40e7e0451f8daa2ba4.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_579f05292145619051cb1a5627e665d1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_ce71941907919cceac8df7a08657404e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_616542403fc0ed81f851560589cdb38f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_57235469703be36182fb786348a4f4b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_bf914f06684e78cf397bbac3d8087d53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_5cd97c96e2254334fe1abf9bd8975a19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_e24dc278a31c1312ecaaf8e165b94d90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_22fa1d9960d5cef625dd3808fc14515d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_c10a7b739561ae8674847fef2aacad98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_1f787ee9dcdf5f40e7e0451f8daa2ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc7c546-0122-5029-805b-39cc6c550770/6bc7c546-0122-5029-805b-39cc6c550770_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d8f12bca7c7b4370c2ebc19361cb4/pa/TD04886_579f05292145619051cb1a5627e665d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04886%27 HTTP/1.1" 200 None
2026-03-28 09:06:08 [auto1.it] INFO: Saving data for TD04886: {'created_time': 1774688768.476944, 'last_price_update_time': 1774688768.47696, 'auction_closing_time': 1774883081.0}
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD04886') HTTP/1.1" 204 0
2026-03-28 09:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167
2026-03-28 09:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167
2026-03-28 09:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167 to the API
2026-03-28 09:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU59167>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:48Z',
 'fuel_type': 'diesel',
 'id': '0e9fe25c-0dbe-5298-99f6-7627c7332175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU59167',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 187406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_6d823f27b736e2a253a3b6ec25a3756a.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5cebe9c945ba17e5bf4b017d6e15e755.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_e86db4ea0d83953d2532eb33de179a2e.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_cdee39bc66a5c85e5d5e80354ed2ae62.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_d1aeae5a03366dfec0e93f26ef9ac72e.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_4469369c52252595de86cfc35c7a01c7.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_56fc560f355bbe8b3e266721df358562.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5b010a208559d1183724af8abb4df2a1.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5035672e4cae64c7105f96929661e887.jpg',
                'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_535bcf291461ff34ba36978d453672fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_6d823f27b736e2a253a3b6ec25a3756a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5cebe9c945ba17e5bf4b017d6e15e755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_e86db4ea0d83953d2532eb33de179a2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_cdee39bc66a5c85e5d5e80354ed2ae62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_d1aeae5a03366dfec0e93f26ef9ac72e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_4469369c52252595de86cfc35c7a01c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_56fc560f355bbe8b3e266721df358562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5b010a208559d1183724af8abb4df2a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_5035672e4cae64c7105f96929661e887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9fe25c-0dbe-5298-99f6-7627c7332175/0e9fe25c-0dbe-5298-99f6-7627c7332175_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/df/5fdfb0054558c3074a5929bdc5a458ee/pa/TU59167_535bcf291461ff34ba36978d453672fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59167%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [auto1.it] INFO: Saving data for TU59167: {'created_time': 1774688769.329015, 'last_price_update_time': 1774688769.329025, 'auction_closing_time': 1774885308.0}
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU59167') HTTP/1.1" 204 0
2026-03-28 09:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591
2026-03-28 09:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591
2026-03-28 09:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591 to the API
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NU26591>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '4.0L',
 'engine_horse_power': 435,
 'expiration_date': '2026-03-30T15:47:01Z',
 'fuel_type': 'diesel',
 'id': '95b064af-bfba-53a2-a199-97b5474b8605',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU26591',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'SQ8',
 'odometer': 214761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_f608283ec02eba5c8bb41b4f168bba32.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_ab777c1ca72eddab4a9fb8380ed4efb8.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_1bec2e0761c1ddfb8034f208ef5e9c67.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_701ab3b198493ee1b3231a0dc8e2e9a8.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_04b7e93d193d155282ea358bc9437142.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_b3e74d8f7e2ff0424c4e254a82814ba5.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_0ac6aa4225b72f4f5fc1be9c5591311b.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_7060f5de841bf8169f950b89a19d77be.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_ab3fa96e73506219e744825f981d05c4.jpg',
                'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_9900d8a4201b16f0bc75751955fd31a2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_f608283ec02eba5c8bb41b4f168bba32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_ab777c1ca72eddab4a9fb8380ed4efb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_1bec2e0761c1ddfb8034f208ef5e9c67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_701ab3b198493ee1b3231a0dc8e2e9a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_04b7e93d193d155282ea358bc9437142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2747856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_b3e74d8f7e2ff0424c4e254a82814ba5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_0ac6aa4225b72f4f5fc1be9c5591311b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_7060f5de841bf8169f950b89a19d77be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_ab3fa96e73506219e744825f981d05c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b064af-bfba-53a2-a199-97b5474b8605/95b064af-bfba-53a2-a199-97b5474b8605_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/c3/8ac3f71a2f63946d05b023e03f692b56/pa/NU26591_9900d8a4201b16f0bc75751955fd31a2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ8 4.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU26591%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [auto1.it] INFO: Saving data for NU26591: {'created_time': 1774688769.675773, 'last_price_update_time': 1774688769.675783, 'auction_closing_time': 1774885621.0}
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NU26591') HTTP/1.1" 204 0
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_bdf7a84cb5e933a0d4201b1e76ac99d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_727df96f7bf31ddbc83da1ade48be85e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_b91159808c65dd106e40987697a9fbce.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_fe66eb89a7b9ba7db8d18a39f753de55.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:09 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH04778%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [auto1.it] INFO: Scrape type for MH04778: 1
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_1774adbd279fe8214056e15a697a8e98.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_1774adbd279fe8214056e15a697a8e98.jpg not downloaded yet
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_c57fafe4ff10c8b5d62e53a18ba77a9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c57fafe4ff10c8b5d62e53a18ba77a9d.jpg not downloaded yet
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR71782> (referer: https://www.auto1.com/v1/car-details-view/YR71782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC15950> (referer: https://www.auto1.com/v1/car-details-view/GC15950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082
2026-03-28 09:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4557617-4b44-5adc-99d6-a74dd5a5ce51 with scrape type 1
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_bf621ab836bebf4d96c71d582a740119.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_bf621ab836bebf4d96c71d582a740119.jpg not downloaded yet
2026-03-28 09:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-03-28 09:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with scrape type 1
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_766e9c695aa178c31e69322cb6b3b6db.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg not downloaded yet
2026-03-28 09:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:09 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-28 09:06:09 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-28 09:06:09 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW00940%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [auto1.it] INFO: Scrape type for UW00940: 1
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_f5d91326bdf3782efc93c452b6d6bf44.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_f5d91326bdf3782efc93c452b6d6bf44.jpg not downloaded yet
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_f30e6c3312eaa0558f4b40650df0290c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_f30e6c3312eaa0558f4b40650df0290c.jpg not downloaded yet
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_0dbcb81dddce1fa10839bef5d7f8dbd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_0dbcb81dddce1fa10839bef5d7f8dbd1.jpg not downloaded yet
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_82530a980651e9425ef554d1ef4dd9c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg not downloaded yet
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9e49e07815a24d31c17b22a3b0eaa63e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_59823ca9e9fb7db12a3ceb3579e22d40.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c4fe16da11123bc43892ece020dc00e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:09 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR16346%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [auto1.it] INFO: Scrape type for CR16346: 1
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_551e99556517249b77c401c307b4b068.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_551e99556517249b77c401c307b4b068.jpg not downloaded yet
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_e936516f94247bc610a10f9e783136da.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_e936516f94247bc610a10f9e783136da.jpg not downloaded yet
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_49584029ebfc5cdaa9cd4173eeaa868e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_49584029ebfc5cdaa9cd4173eeaa868e.jpg not downloaded yet
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_5041c086462b694b0f8094a7a90aa0ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg not downloaded yet
2026-03-28 09:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067d2f90>
2026-03-28 09:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_bdf7a84cb5e933a0d4201b1e76ac99d9.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_bdf7a84cb5e933a0d4201b1e76ac99d9.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0d4450>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_727df96f7bf31ddbc83da1ade48be85e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_727df96f7bf31ddbc83da1ade48be85e.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067bd990>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_b91159808c65dd106e40987697a9fbce.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_b91159808c65dd106e40987697a9fbce.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_3824e0245a7ddc29d79c0e5fd5f1bef5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:10 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD21393%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [auto1.it] INFO: Scrape type for PD21393: 1
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_847f55b403828df9487fab1bf50a7ba8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_847f55b403828df9487fab1bf50a7ba8.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_9ba6acf8c35f352b82c3e6c0e9695650.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9ba6acf8c35f352b82c3e6c0e9695650.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_2e41429075d50ed505fb517969c31374.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_2e41429075d50ed505fb517969c31374.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_c50bb63112347d529c2b567bb748ce3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg not downloaded yet
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065c8410>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_fe66eb89a7b9ba7db8d18a39f753de55.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_fe66eb89a7b9ba7db8d18a39f753de55.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782
2026-03-28 09:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3022335d-6f84-581b-b193-8873e4bbb075 with scrape type 1
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3022335d-6f84-581b-b193-8873e4bbb075
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_5b9cf0360dcb83eebd439005d9173d70.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_5b9cf0360dcb83eebd439005d9173d70.jpg not downloaded yet
2026-03-28 09:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950
2026-03-28 09:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e with scrape type 1
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_cb772d5b1aa362e4d9db50b3a9f09966.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_cb772d5b1aa362e4d9db50b3a9f09966.jpg not downloaded yet
2026-03-28 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_5d9cf4913dc1a478dc625d9e4dcccd30.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_a10817d8b7a18f26291cc6c7dab55746.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2dc710>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_9e49e07815a24d31c17b22a3b0eaa63e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9e49e07815a24d31c17b22a3b0eaa63e.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06597510>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_59823ca9e9fb7db12a3ceb3579e22d40.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_59823ca9e9fb7db12a3ceb3579e22d40.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067db4d0>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_c4fe16da11123bc43892ece020dc00e3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c4fe16da11123bc43892ece020dc00e3.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_f30e6c3312eaa0558f4b40650df0290c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:10 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-28 09:06:10 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK62729%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [auto1.it] INFO: Scrape type for XK62729: 1
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_6aa65770d24981d4d87d927a05b12221.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_6aa65770d24981d4d87d927a05b12221.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_94ec5ed417e2ef95ea950b59d7360194.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_94ec5ed417e2ef95ea950b59d7360194.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_17b3508d9e4604fa498edd6ac485deb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_17b3508d9e4604fa498edd6ac485deb1.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_83e529ccb49edb2ce9e63d09ca25dd7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_83e529ccb49edb2ce9e63d09ca25dd7a.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_a5093d12e575b8947d788e3d22931e52.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_a5093d12e575b8947d788e3d22931e52.jpg not downloaded yet
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c758510>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_3824e0245a7ddc29d79c0e5fd5f1bef5.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_3824e0245a7ddc29d79c0e5fd5f1bef5.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_0dbcb81dddce1fa10839bef5d7f8dbd1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:10 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD17279%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [auto1.it] INFO: Scrape type for BD17279: 2
2026-03-28 09:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279
2026-03-28 09:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with scrape type 2
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with scrape type 2
2026-03-28 09:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1, identifier: BD17279
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_03746f765219b945474a2598c334d8d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_03746f765219b945474a2598c334d8d6.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_756186ed86b2dd0b043558bf9397c114.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_756186ed86b2dd0b043558bf9397c114.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_eca4f3d3af907471deb3b7e3baf3661c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_eca4f3d3af907471deb3b7e3baf3661c.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_08bc523b3fcab1368b9aec2d23e41777.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_c2fe0a7afd1ee0659b48d776918645be.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_c2fe0a7afd1ee0659b48d776918645be.jpg not downloaded yet
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_eece59c425a23d92e4803de175060f84.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_eece59c425a23d92e4803de175060f84.jpg not downloaded yet
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0f4750>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_5d9cf4913dc1a478dc625d9e4dcccd30.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_5d9cf4913dc1a478dc625d9e4dcccd30.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db28c90>
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_a10817d8b7a18f26291cc6c7dab55746.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_a10817d8b7a18f26291cc6c7dab55746.jpg saved to cache
2026-03-28 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_f5d91326bdf3782efc93c452b6d6bf44.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279
2026-03-28 09:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279
2026-03-28 09:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279 to the API
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'diesel',
 'id': '8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD17279',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 176031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-11',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2016}
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD17279%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [auto1.it] INFO: Saving data for BD17279: {'auction_closing_time': 1774884877.0, 'created_time': 1773954829.453781, 'last_price_update_time': 1774688771.303261}
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD17279') HTTP/1.1" 204 0
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06599f50>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_f30e6c3312eaa0558f4b40650df0290c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_f30e6c3312eaa0558f4b40650df0290c.jpg saved to cache
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_49584029ebfc5cdaa9cd4173eeaa868e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ74443%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [auto1.it] INFO: Scrape type for PZ74443: 1
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_ab676d57f8feee3e8df8fbbfc0039a87.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_ab676d57f8feee3e8df8fbbfc0039a87.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_3bd04a205ec667a4393ae0c463968522.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_3bd04a205ec667a4393ae0c463968522.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_c4546f1699bcda5f122c66a2c66e33f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_c4546f1699bcda5f122c66a2c66e33f2.jpg not downloaded yet
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_cb772d5b1aa362e4d9db50b3a9f09966.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067e0f90>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_0dbcb81dddce1fa10839bef5d7f8dbd1.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_0dbcb81dddce1fa10839bef5d7f8dbd1.jpg saved to cache
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067d6710>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_82530a980651e9425ef554d1ef4dd9c9.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg saved to cache
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF91853%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [auto1.it] INFO: Scrape type for DF91853: 1
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_d6ed9ba7644caeb7410584437fbffe86.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_d6ed9ba7644caeb7410584437fbffe86.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_d292d9297acc87c1e6ddf28457e8206f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_96ccb7da0f3d6257f5334cc79e7ff7a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_96ccb7da0f3d6257f5334cc79e7ff7a1.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_bb0493a5ea54b2a67ce85f5e07cbf454.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_bb0493a5ea54b2a67ce85f5e07cbf454.jpg not downloaded yet
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG05236> (referer: https://www.auto1.com/v1/car-details-view/RG05236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065e6690>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_f5d91326bdf3782efc93c452b6d6bf44.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_f5d91326bdf3782efc93c452b6d6bf44.jpg saved to cache
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_83e529ccb49edb2ce9e63d09ca25dd7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_a5093d12e575b8947d788e3d22931e52.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR54078%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [auto1.it] INFO: Scrape type for TR54078: 1
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_be25f0d74bdff2541669cd5ca6b4bda2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_be25f0d74bdff2541669cd5ca6b4bda2.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_beece74efd670c7a6d6954b908745873.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_0581ffd63d28df3376eedf88727f9b3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_0581ffd63d28df3376eedf88727f9b3d.jpg not downloaded yet
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1c3490>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_49584029ebfc5cdaa9cd4173eeaa868e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_49584029ebfc5cdaa9cd4173eeaa868e.jpg saved to cache
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c098410>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_cb772d5b1aa362e4d9db50b3a9f09966.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_cb772d5b1aa362e4d9db50b3a9f09966.jpg saved to cache
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065ea310>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_5041c086462b694b0f8094a7a90aa0ff.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg saved to cache
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_eece59c425a23d92e4803de175060f84.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG70821%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [auto1.it] INFO: Scrape type for LG70821: 1
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_8664de2304747b5ec2dcbb8f73fb8321.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_8664de2304747b5ec2dcbb8f73fb8321.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_db3e0e0624360f16d3d68e205c451f38.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg not downloaded yet
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_ee1f582d1ca9e01764d5da6e38d7f2d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_ee1f582d1ca9e01764d5da6e38d7f2d2.jpg not downloaded yet
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_c2fe0a7afd1ee0659b48d776918645be.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP98022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB28979> (referer: https://www.auto1.com/v1/car-details-view/CB28979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX70685> (referer: https://www.auto1.com/v1/car-details-view/RX70685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236
2026-03-28 09:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c54439-704b-595e-9960-e714f6dd07ba with scrape type 1
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 49c54439-704b-595e-9960-e714f6dd07ba
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_7444931d66d1dfe6f661e0cf5aa90a7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_7444931d66d1dfe6f661e0cf5aa90a7c.jpg not downloaded yet
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067e3150>
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_83e529ccb49edb2ce9e63d09ca25dd7a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_83e529ccb49edb2ce9e63d09ca25dd7a.jpg saved to cache
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3022335d-6f84-581b-b193-8873e4bbb075
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0676ee50>
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_a5093d12e575b8947d788e3d22931e52.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_a5093d12e575b8947d788e3d22931e52.jpg saved to cache
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_c4546f1699bcda5f122c66a2c66e33f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:12 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-28 09:06:12 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD30072%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [auto1.it] INFO: Scrape type for PD30072: 1
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_4633c96831bd3b0d617fad6cd718b353.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_4633c96831bd3b0d617fad6cd718b353.jpg not downloaded yet
2026-03-28 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP64063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_bb0493a5ea54b2a67ce85f5e07cbf454.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_96ccb7da0f3d6257f5334cc79e7ff7a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_23a11ccf2002b4f2e2fac4f935053676.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_23a11ccf2002b4f2e2fac4f935053676.jpg not downloaded yet
2026-03-28 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:12 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN93360%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [auto1.it] INFO: Scrape type for PN93360: 2
2026-03-28 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360
2026-03-28 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1480ce-4d07-58bb-9f18-6a35b429a113 with scrape type 2
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa1480ce-4d07-58bb-9f18-6a35b429a113 with scrape type 2
2026-03-28 09:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa1480ce-4d07-58bb-9f18-6a35b429a113, identifier: PN93360
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_9027ec6d938874818e3d8da2e90d35bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_9027ec6d938874818e3d8da2e90d35bc.jpg not downloaded yet
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1e7d10>
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg saved to cache
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c271990>
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_eece59c425a23d92e4803de175060f84.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_eece59c425a23d92e4803de175060f84.jpg saved to cache
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067ed290>
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_c2fe0a7afd1ee0659b48d776918645be.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_c2fe0a7afd1ee0659b48d776918645be.jpg saved to cache
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3022335d-6f84-581b-b193-8873e4bbb075
2026-03-28 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979
2026-03-28 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with scrape type 1
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_e23a6c6d951157219d276b5591e412ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e23a6c6d951157219d276b5591e412ed.jpg not downloaded yet
2026-03-28 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685
2026-03-28 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdbf227c-bd50-5928-800a-c959a597da67 with scrape type 1
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_35c2442a9960cdb25dccf265e037db2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_35c2442a9960cdb25dccf265e037db2e.jpg not downloaded yet
2026-03-28 09:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360
2026-03-28 09:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360
2026-03-28 09:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360 to the API
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:44:15Z',
 'fuel_type': 'diesel',
 'id': 'aa1480ce-4d07-58bb-9f18-6a35b429a113',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN93360',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 123513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Energy BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2018}
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN93360%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [auto1.it] INFO: Saving data for PN93360: {'auction_closing_time': 1774885455.0, 'created_time': 1773954573.727023, 'last_price_update_time': 1774688772.735061}
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PN93360') HTTP/1.1" 204 0
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_3627d0efaab9f33d43c70dd219365a12.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_3627d0efaab9f33d43c70dd219365a12.jpg not downloaded yet
2026-03-28 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_ee1f582d1ca9e01764d5da6e38d7f2d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:12 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-28 09:06:12 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-28 09:06:12 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP46420%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [auto1.it] INFO: Scrape type for GP46420: 1
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_59e2ef4b99d41d3ac77e3218e37520f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_59e2ef4b99d41d3ac77e3218e37520f5.jpg not downloaded yet
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_b408f8973fe2a2584d1de5f673d582d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_b408f8973fe2a2584d1de5f673d582d7.jpg not downloaded yet
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_56cca9b816dacfe4ec7bfeca56f11389.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_56cca9b816dacfe4ec7bfeca56f11389.jpg not downloaded yet
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_be25f0d74bdff2541669cd5ca6b4bda2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_0581ffd63d28df3376eedf88727f9b3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_8664de2304747b5ec2dcbb8f73fb8321.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_a4b3aa71f3d189fc45e1a4e151c1a7ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_a4b3aa71f3d189fc45e1a4e151c1a7ee.jpg not downloaded yet
2026-03-28 09:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c08b550>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_c4546f1699bcda5f122c66a2c66e33f2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_c4546f1699bcda5f122c66a2c66e33f2.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06793010>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_08bc523b3fcab1368b9aec2d23e41777.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065f6f90>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_bb0493a5ea54b2a67ce85f5e07cbf454.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_bb0493a5ea54b2a67ce85f5e07cbf454.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c18fcd0>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_96ccb7da0f3d6257f5334cc79e7ff7a1.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_96ccb7da0f3d6257f5334cc79e7ff7a1.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3022335d-6f84-581b-b193-8873e4bbb075
2026-03-28 09:06:13 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_7444931d66d1dfe6f661e0cf5aa90a7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_a182c9457aa2dc7d65147c5d0cba3930.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a182c9457aa2dc7d65147c5d0cba3930.jpg not downloaded yet
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_3edc1929974a58cba795344f249cfb51.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_3edc1929974a58cba795344f249cfb51.jpg not downloaded yet
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_31e1357846d6106a1433afc78321de5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_31e1357846d6106a1433afc78321de5a.jpg not downloaded yet
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX75497%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [auto1.it] INFO: Scrape type for DX75497: 2
2026-03-28 09:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497
2026-03-28 09:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with scrape type 2
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with scrape type 2
2026-03-28 09:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d, identifier: DX75497
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1a6950>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_ee1f582d1ca9e01764d5da6e38d7f2d2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_ee1f582d1ca9e01764d5da6e38d7f2d2.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_e914c4086b4e24f8e9a61e6b1e10c7f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e914c4086b4e24f8e9a61e6b1e10c7f6.jpg not downloaded yet
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_1cd2d705806e4c47fbe30b699daf7a33.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_1cd2d705806e4c47fbe30b699daf7a33.jpg not downloaded yet
2026-03-28 09:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497
2026-03-28 09:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497
2026-03-28 09:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497 to the API
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:42:12Z',
 'fuel_type': 'diesel',
 'id': '836b0b1d-3b05-5a9c-baaf-b3d91c48482d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX75497',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 215682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2012}
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX75497%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [auto1.it] INFO: Saving data for DX75497: {'auction_closing_time': 1774885332.0, 'created_time': 1774343162.792023, 'last_price_update_time': 1774688773.744616}
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX75497') HTTP/1.1" 204 0
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0660e3d0>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_be25f0d74bdff2541669cd5ca6b4bda2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_be25f0d74bdff2541669cd5ca6b4bda2.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06758950>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_0581ffd63d28df3376eedf88727f9b3d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_0581ffd63d28df3376eedf88727f9b3d.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066dc290>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_db3e0e0624360f16d3d68e205c451f38.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066eeb50>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_8664de2304747b5ec2dcbb8f73fb8321.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_8664de2304747b5ec2dcbb8f73fb8321.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065f9f10>
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_beece74efd670c7a6d6954b908745873.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg saved to cache
2026-03-28 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_d6ed9ba7644caeb7410584437fbffe86.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-28 09:06:13 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ50775%27 HTTP/1.1" 200 None
2026-03-28 09:06:13 [auto1.it] INFO: Scrape type for CJ50775: 1
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC10641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_35c2442a9960cdb25dccf265e037db2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_4633c96831bd3b0d617fad6cd718b353.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_9027ec6d938874818e3d8da2e90d35bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_3627d0efaab9f33d43c70dd219365a12.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e23a6c6d951157219d276b5591e412ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_fbe2579d686b45657ef37c96ad31f368.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_fbe2579d686b45657ef37c96ad31f368.jpg not downloaded yet
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_95d5946bae3ff1ed30335bcef762438c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_95d5946bae3ff1ed30335bcef762438c.jpg not downloaded yet
2026-03-28 09:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0728d0>
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_7444931d66d1dfe6f661e0cf5aa90a7c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_7444931d66d1dfe6f661e0cf5aa90a7c.jpg saved to cache
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49c54439-704b-595e-9960-e714f6dd07ba
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR24813%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [auto1.it] INFO: Scrape type for KR24813: 1
2026-03-28 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC99655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_137949ade0e4dfc237a6ace07190f215.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_137949ade0e4dfc237a6ace07190f215.jpg not downloaded yet
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_05ca527d5f86d5333b6a6565cd92aa73.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_05ca527d5f86d5333b6a6565cd92aa73.jpg not downloaded yet
2026-03-28 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_23a11ccf2002b4f2e2fac4f935053676.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK99486%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [auto1.it] INFO: Scrape type for KK99486: 2
2026-03-28 09:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486
2026-03-28 09:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with scrape type 2
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with scrape type 2
2026-03-28 09:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93, identifier: KK99486
2026-03-28 09:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0f291cd0>
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_d6ed9ba7644caeb7410584437fbffe86.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_d6ed9ba7644caeb7410584437fbffe86.jpg saved to cache
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ceee493f3c96df2f90d3bb148bd56fee.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_17c0b87a273e91937bb984964e3820be.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_17c0b87a273e91937bb984964e3820be.jpg not downloaded yet
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_7e74298a7a63e6dd6297e4c887c6ce99.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_7e74298a7a63e6dd6297e4c887c6ce99.jpg not downloaded yet
2026-03-28 09:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486
2026-03-28 09:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486
2026-03-28 09:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486 to the API
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:11:47Z',
 'fuel_type': 'diesel',
 'id': '8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK99486',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 390510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-04',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK99486%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [auto1.it] INFO: Saving data for KK99486: {'auction_closing_time': 1774883507.0, 'created_time': 1773129555.083647, 'last_price_update_time': 1774688774.646244}
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK99486') HTTP/1.1" 204 0
2026-03-28 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_31e1357846d6106a1433afc78321de5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:14 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW14976%27 HTTP/1.1" 200 None
2026-03-28 09:06:14 [auto1.it] INFO: Scrape type for XW14976: 2
2026-03-28 09:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976
2026-03-28 09:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with scrape type 2
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with scrape type 2
2026-03-28 09:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7ebd1c3-b242-585c-a31e-72018cbd5ae9, identifier: XW14976
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065fb4d0>
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_35c2442a9960cdb25dccf265e037db2e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_35c2442a9960cdb25dccf265e037db2e.jpg saved to cache
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0da19b90>
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_4633c96831bd3b0d617fad6cd718b353.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_4633c96831bd3b0d617fad6cd718b353.jpg saved to cache
2026-03-28 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1e8a10>
2026-03-28 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_9027ec6d938874818e3d8da2e90d35bc.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_9027ec6d938874818e3d8da2e90d35bc.jpg saved to cache
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06603cd0>
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_3627d0efaab9f33d43c70dd219365a12.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_3627d0efaab9f33d43c70dd219365a12.jpg saved to cache
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49c54439-704b-595e-9960-e714f6dd07ba
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0675a250>
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_d292d9297acc87c1e6ddf28457e8206f.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg saved to cache
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c26c1d0>
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_e23a6c6d951157219d276b5591e412ed.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e23a6c6d951157219d276b5591e412ed.jpg saved to cache
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_1cd2d705806e4c47fbe30b699daf7a33.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_56cca9b816dacfe4ec7bfeca56f11389.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_3edc1929974a58cba795344f249cfb51.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e914c4086b4e24f8e9a61e6b1e10c7f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_71686608b11ee5b9c2d181a758e2a71a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_71686608b11ee5b9c2d181a758e2a71a.jpg not downloaded yet
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_97953ad1b5851757dd0a1eab2cc9bca3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_97953ad1b5851757dd0a1eab2cc9bca3.jpg not downloaded yet
2026-03-28 09:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976
2026-03-28 09:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976
2026-03-28 09:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976 to the API
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:05Z',
 'fuel_type': 'diesel',
 'id': 'd7ebd1c3-b242-585c-a31e-72018cbd5ae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW14976',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 186471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-22',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2017}
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW14976%27 HTTP/1.1" 200 None
2026-03-28 09:06:15 [auto1.it] INFO: Saving data for XW14976: {'auction_closing_time': 1774885625.0, 'created_time': 1773997743.881776, 'last_price_update_time': 1774688775.535625}
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW14976') HTTP/1.1" 204 0
2026-03-28 09:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_a4b3aa71f3d189fc45e1a4e151c1a7ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:15 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV32353%27 HTTP/1.1" 200 None
2026-03-28 09:06:15 [auto1.it] INFO: Scrape type for CV32353: 2
2026-03-28 09:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353
2026-03-28 09:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e044c2-49f2-53e9-9e8d-8c20364b2728 with scrape type 2
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e044c2-49f2-53e9-9e8d-8c20364b2728 with scrape type 2
2026-03-28 09:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75e044c2-49f2-53e9-9e8d-8c20364b2728, identifier: CV32353
2026-03-28 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG70821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR54078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065be290>
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_23a11ccf2002b4f2e2fac4f935053676.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_23a11ccf2002b4f2e2fac4f935053676.jpg saved to cache
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49c54439-704b-595e-9960-e714f6dd07ba
2026-03-28 09:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0b10d0>
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_ceee493f3c96df2f90d3bb148bd56fee.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ceee493f3c96df2f90d3bb148bd56fee.jpg saved to cache
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_e8dfb26ffe07b103eff940636a69e7db.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e8dfb26ffe07b103eff940636a69e7db.jpg not downloaded yet
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_2863a10ade0d116442aa4df883e81f04.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_2863a10ade0d116442aa4df883e81f04.jpg not downloaded yet
2026-03-28 09:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353
2026-03-28 09:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353
2026-03-28 09:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353 to the API
2026-03-28 09:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:27:14Z',
 'fuel_type': 'diesel',
 'id': '75e044c2-49f2-53e9-9e8d-8c20364b2728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV32353',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 148237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2015}
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV32353%27 HTTP/1.1" 200 None
2026-03-28 09:06:16 [auto1.it] INFO: Saving data for CV32353: {'auction_closing_time': 1774884434.0, 'created_time': 1773130269.150676, 'last_price_update_time': 1774688776.169281}
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV32353') HTTP/1.1" 204 0
2026-03-28 09:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP98022> (referer: https://www.auto1.com/v1/car-details-view/DP98022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0673b210>
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_31e1357846d6106a1433afc78321de5a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_31e1357846d6106a1433afc78321de5a.jpg saved to cache
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49c54439-704b-595e-9960-e714f6dd07ba
2026-03-28 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_05ca527d5f86d5333b6a6565cd92aa73.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_95d5946bae3ff1ed30335bcef762438c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:16 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-28 09:06:16 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE49798%27 HTTP/1.1" 200 None
2026-03-28 09:06:16 [auto1.it] INFO: Scrape type for YE49798: 1
2026-03-28 09:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0652d690>
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_1cd2d705806e4c47fbe30b699daf7a33.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_1cd2d705806e4c47fbe30b699daf7a33.jpg saved to cache
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06601b50>
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_56cca9b816dacfe4ec7bfeca56f11389.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_56cca9b816dacfe4ec7bfeca56f11389.jpg saved to cache
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06276ad0>
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_3edc1929974a58cba795344f249cfb51.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_3edc1929974a58cba795344f249cfb51.jpg saved to cache
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067db690>
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_e914c4086b4e24f8e9a61e6b1e10c7f6.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e914c4086b4e24f8e9a61e6b1e10c7f6.jpg saved to cache
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_7e74298a7a63e6dd6297e4c887c6ce99.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_a39767645dec3b7f45dba4753769b2cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a39767645dec3b7f45dba4753769b2cc.jpg not downloaded yet
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_9f2b24a58ae97ed8c95e6a1d7c0ccb47.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_9f2b24a58ae97ed8c95e6a1d7c0ccb47.jpg not downloaded yet
2026-03-28 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK55043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1fa190>
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fc1%252F9ac14877c9687696fbb988b709bb32e5%252Fpa%252FRG05236_a4b3aa71f3d189fc45e1a4e151c1a7ee.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_a4b3aa71f3d189fc45e1a4e151c1a7ee.jpg saved to cache
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49c54439-704b-595e-9960-e714f6dd07ba
2026-03-28 09:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49c54439-704b-595e-9960-e714f6dd07ba, skipping ID generation
2026-03-28 09:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c54439-704b-595e-9960-e714f6dd07ba with scrape type 1
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49c54439-704b-595e-9960-e714f6dd07ba sending to next pipeline
2026-03-28 09:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49c54439-704b-595e-9960-e714f6dd07ba, identifier: RG05236
2026-03-28 09:06:16 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-28 09:06:16 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL30423%27 HTTP/1.1" 200 None
2026-03-28 09:06:16 [auto1.it] INFO: Scrape type for UL30423: 2
2026-03-28 09:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423
2026-03-28 09:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4530052-df44-52af-ac60-a09aba23674a with scrape type 2
2026-03-28 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4530052-df44-52af-ac60-a09aba23674a with scrape type 2
2026-03-28 09:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4530052-df44-52af-ac60-a09aba23674a, identifier: UL30423
2026-03-28 09:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236
2026-03-28 09:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236
2026-03-28 09:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236 to the API
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_a4b3aa71f3d189fc45e1a4e151c1a7ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:36:43Z',
 'fuel_type': 'diesel',
 'id': '49c54439-704b-595e-9960-e714f6dd07ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG05236',
 'listing': 'auction',
 'location': 'IT, Agliana (PT)',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 223085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_7444931d66d1dfe6f661e0cf5aa90a7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_23a11ccf2002b4f2e2fac4f935053676.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_3627d0efaab9f33d43c70dd219365a12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_a4b3aa71f3d189fc45e1a4e151c1a7ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c54439-704b-595e-9960-e714f6dd07ba/49c54439-704b-595e-9960-e714f6dd07ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/c1/9ac14877c9687696fbb988b709bb32e5/pa/RG05236_31e1357846d6106a1433afc78321de5a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Societé',
 'transmission': 'manual',
 'trim': 'Societé',
 'year': 2016}
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG05236%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [auto1.it] INFO: Saving data for RG05236: {'created_time': 1774688777.07607, 'last_price_update_time': 1774688777.076079, 'auction_closing_time': 1774885003.0}
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG05236') HTTP/1.1" 204 0
2026-03-28 09:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423
2026-03-28 09:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423
2026-03-28 09:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423 to the API
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:31:16Z',
 'fuel_type': 'petrol',
 'id': 'b4530052-df44-52af-ac60-a09aba23674a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL30423',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 116248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-01',
 'seller_name': None,
 'title': 'Honda Civic 1.4 DSi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL30423%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [auto1.it] INFO: Saving data for UL30423: {'auction_closing_time': 1774884676.0, 'created_time': 1773129793.8563, 'last_price_update_time': 1774688777.429653}
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL30423') HTTP/1.1" 204 0
2026-03-28 09:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022
2026-03-28 09:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363e61f7-4252-5bf0-a1b2-0d180a176ffb with scrape type 1
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 363e61f7-4252-5bf0-a1b2-0d180a176ffb
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F34%252Fbc34760ace1404631198feef8e6b7266%252Fpa%252FDP98022_386e6c8eb30ae47554045d88c0139269.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_386e6c8eb30ae47554045d88c0139269.jpg already downloaded
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F34%252Fbc34760ace1404631198feef8e6b7266%252Fpa%252FDP98022_f30ee579fc26f0e95bfc7267bc5f6cdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_f30ee579fc26f0e95bfc7267bc5f6cdd.jpg already downloaded
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F34%252Fbc34760ace1404631198feef8e6b7266%252Fpa%252FDP98022_0346814d6652c4f7d5ecceab8130210a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_0346814d6652c4f7d5ecceab8130210a.jpg already downloaded
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F34%252Fbc34760ace1404631198feef8e6b7266%252Fpa%252FDP98022_234d052b3154508baeb5c2d34769d092.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_234d052b3154508baeb5c2d34769d092.jpg already downloaded
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F34%252Fbc34760ace1404631198feef8e6b7266%252Fpa%252FDP98022_6a18625ffe96b0b31fde96f63595939c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_6a18625ffe96b0b31fde96f63595939c.jpg already downloaded
2026-03-28 09:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 363e61f7-4252-5bf0-a1b2-0d180a176ffb, identifier: DP98022
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0a26d0>
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_05ca527d5f86d5333b6a6565cd92aa73.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_05ca527d5f86d5333b6a6565cd92aa73.jpg saved to cache
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067596d0>
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_95d5946bae3ff1ed30335bcef762438c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_95d5946bae3ff1ed30335bcef762438c.jpg saved to cache
2026-03-28 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_97953ad1b5851757dd0a1eab2cc9bca3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:17 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-28 09:06:17 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-28 09:06:17 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW75734%27 HTTP/1.1" 200 None
2026-03-28 09:06:17 [auto1.it] INFO: Scrape type for SW75734: 1
2026-03-28 09:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022
2026-03-28 09:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022
2026-03-28 09:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022 to the API
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP98022>
{'auction_title': '',
 'c_o_2_emission_value': 238,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'diesel',
 'id': '363e61f7-4252-5bf0-a1b2-0d180a176ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP98022',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Opel',
 'model': 'Antara',
 'odometer': 176271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_386e6c8eb30ae47554045d88c0139269.jpg',
                'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_f30ee579fc26f0e95bfc7267bc5f6cdd.jpg',
                'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_0346814d6652c4f7d5ecceab8130210a.jpg',
                'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_234d052b3154508baeb5c2d34769d092.jpg',
                'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_6a18625ffe96b0b31fde96f63595939c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363e61f7-4252-5bf0-a1b2-0d180a176ffb/363e61f7-4252-5bf0-a1b2-0d180a176ffb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_386e6c8eb30ae47554045d88c0139269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363e61f7-4252-5bf0-a1b2-0d180a176ffb/363e61f7-4252-5bf0-a1b2-0d180a176ffb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_f30ee579fc26f0e95bfc7267bc5f6cdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363e61f7-4252-5bf0-a1b2-0d180a176ffb/363e61f7-4252-5bf0-a1b2-0d180a176ffb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_0346814d6652c4f7d5ecceab8130210a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363e61f7-4252-5bf0-a1b2-0d180a176ffb/363e61f7-4252-5bf0-a1b2-0d180a176ffb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_234d052b3154508baeb5c2d34769d092.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363e61f7-4252-5bf0-a1b2-0d180a176ffb/363e61f7-4252-5bf0-a1b2-0d180a176ffb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/34/bc34760ace1404631198feef8e6b7266/pa/DP98022_6a18625ffe96b0b31fde96f63595939c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Antara 2.0 CDTI Cosmo 4x4',
 'transmission': 'automatic',
 'trim': 'Cosmo 4x4',
 'year': 2009}
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98022%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Saving data for DP98022: {'created_time': 1774688778.048225, 'last_price_update_time': 1774688778.048236, 'auction_closing_time': 1774883890.0}
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP98022') HTTP/1.1" 204 0
2026-03-28 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_59e2ef4b99d41d3ac77e3218e37520f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR24813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065ddbd0>
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_7e74298a7a63e6dd6297e4c887c6ce99.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_7e74298a7a63e6dd6297e4c887c6ce99.jpg saved to cache
2026-03-28 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK64691%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for UK64691: 0
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN61279%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for AN61279: 0
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT86375%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for LT86375: 0
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY62021%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for TY62021: 0
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH51725%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for EH51725: 0
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL55256%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for NL55256: 0
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: YH23554
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH23554%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for YH23554: 2
2026-03-28 09:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5cc8383-7d69-5671-b8f5-d809fb554ae7 with identifier: YH23554
2026-03-28 09:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5cc8383-7d69-5671-b8f5-d809fb554ae7 with scrape type 2
2026-03-28 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5cc8383-7d69-5671-b8f5-d809fb554ae7 with scrape type 2
2026-03-28 09:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5cc8383-7d69-5671-b8f5-d809fb554ae7, identifier: YH23554
2026-03-28 09:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP64063> (referer: https://www.auto1.com/v1/car-details-view/EP64063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5cc8383-7d69-5671-b8f5-d809fb554ae7 with identifier: YH23554
2026-03-28 09:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5cc8383-7d69-5671-b8f5-d809fb554ae7 with identifier: YH23554
2026-03-28 09:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c5cc8383-7d69-5671-b8f5-d809fb554ae7 with identifier: YH23554 to the API
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:07:26Z',
 'fuel_type': 'diesel',
 'id': 'c5cc8383-7d69-5671-b8f5-d809fb554ae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH23554',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 63241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-23',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2020}
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH23554%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Saving data for YH23554: {'auction_closing_time': 1774714046.0, 'created_time': 1772178424.374931, 'last_price_update_time': 1774688778.673422}
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH23554') HTTP/1.1" 204 0
2026-03-28 09:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: NK99622
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-28 09:06:18 [auto1.it] INFO: Found listing with ID: YN45355
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN45355%27 HTTP/1.1" 200 None
2026-03-28 09:06:18 [auto1.it] INFO: Scrape type for YN45355: 2
2026-03-28 09:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23fee9f7-5080-5859-8019-1280be843231 with identifier: YN45355
2026-03-28 09:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fee9f7-5080-5859-8019-1280be843231 with scrape type 2
2026-03-28 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23fee9f7-5080-5859-8019-1280be843231 with scrape type 2
2026-03-28 09:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23fee9f7-5080-5859-8019-1280be843231, identifier: YN45355
2026-03-28 09:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0651ac50>
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_97953ad1b5851757dd0a1eab2cc9bca3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_97953ad1b5851757dd0a1eab2cc9bca3.jpg saved to cache
2026-03-28 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23fee9f7-5080-5859-8019-1280be843231 with identifier: YN45355
2026-03-28 09:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23fee9f7-5080-5859-8019-1280be843231 with identifier: YN45355
2026-03-28 09:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23fee9f7-5080-5859-8019-1280be843231 with identifier: YN45355 to the API
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:53:38Z',
 'fuel_type': 'diesel',
 'id': '23fee9f7-5080-5859-8019-1280be843231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN45355',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 140754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-22',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN45355%27 HTTP/1.1" 200 None
2026-03-28 09:06:19 [auto1.it] INFO: Saving data for YN45355: {'auction_closing_time': 1774716818.0, 'created_time': 1771704766.752702, 'last_price_update_time': 1774688779.319383}
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN45355') HTTP/1.1" 204 0
2026-03-28 09:06:19 [auto1.it] INFO: Found listing with ID: GK54745
2026-03-28 09:06:19 [auto1.it] INFO: Found listing with ID: SR88948
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR88948%27 HTTP/1.1" 200 None
2026-03-28 09:06:19 [auto1.it] INFO: Scrape type for SR88948: 2
2026-03-28 09:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948
2026-03-28 09:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f with scrape type 2
2026-03-28 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f with scrape type 2
2026-03-28 09:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e511f1b-7d74-5878-80ad-55a38cd3a30f, identifier: SR88948
2026-03-28 09:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ50775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066ec590>
2026-03-28 09:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fb7%252F8cb7fd6316a133bce452b46c184d0373%252Fpa%252FGC15950_59e2ef4b99d41d3ac77e3218e37520f5.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_59e2ef4b99d41d3ac77e3218e37520f5.jpg saved to cache
2026-03-28 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e
2026-03-28 09:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dedb6cc-43e3-5afe-b2ad-748f3461719e, skipping ID generation
2026-03-28 09:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e with scrape type 1
2026-03-28 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e sending to next pipeline
2026-03-28 09:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9dedb6cc-43e3-5afe-b2ad-748f3461719e, identifier: GC15950
2026-03-28 09:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063
2026-03-28 09:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with scrape type 1
2026-03-28 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_71754aa83f08bcea30ad2301d96963ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_71754aa83f08bcea30ad2301d96963ef.jpg not downloaded yet
2026-03-28 09:06:19 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948
2026-03-28 09:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948
2026-03-28 09:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948 to the API
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:44:31Z',
 'fuel_type': 'diesel',
 'id': '4e511f1b-7d74-5878-80ad-55a38cd3a30f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR88948',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 110144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR88948%27 HTTP/1.1" 200 None
2026-03-28 09:06:20 [auto1.it] INFO: Saving data for SR88948: {'auction_closing_time': 1774716271.0, 'created_time': 1773132614.263376, 'last_price_update_time': 1774688780.00851}
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR88948') HTTP/1.1" 204 0
2026-03-28 09:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950
2026-03-28 09:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950
2026-03-28 09:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950 to the API
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_59e2ef4b99d41d3ac77e3218e37520f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'diesel',
 'id': '9dedb6cc-43e3-5afe-b2ad-748f3461719e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC15950',
 'listing': 'auction',
 'location': 'IT, Legnano',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 99341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_cb772d5b1aa362e4d9db50b3a9f09966.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_a5093d12e575b8947d788e3d22931e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_eece59c425a23d92e4803de175060f84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_c4546f1699bcda5f122c66a2c66e33f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_bb0493a5ea54b2a67ce85f5e07cbf454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_0581ffd63d28df3376eedf88727f9b3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_ee1f582d1ca9e01764d5da6e38d7f2d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_4633c96831bd3b0d617fad6cd718b353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_9027ec6d938874818e3d8da2e90d35bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dedb6cc-43e3-5afe-b2ad-748f3461719e/9dedb6cc-43e3-5afe-b2ad-748f3461719e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/b7/8cb7fd6316a133bce452b46c184d0373/pa/GC15950_59e2ef4b99d41d3ac77e3218e37520f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC15950%27 HTTP/1.1" 200 None
2026-03-28 09:06:20 [auto1.it] INFO: Saving data for GC15950: {'created_time': 1774688780.387165, 'last_price_update_time': 1774688780.387174, 'auction_closing_time': 1774885237.0}
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC15950') HTTP/1.1" 204 0
2026-03-28 09:06:20 [auto1.it] INFO: Found listing with ID: NR71125
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_28e3b079f16fdb4456d10fc0f6080469.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_28e3b079f16fdb4456d10fc0f6080469.jpg not downloaded yet
2026-03-28 09:06:20 [auto1.it] INFO: Found listing with ID: NS64988
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS64988%27 HTTP/1.1" 200 None
2026-03-28 09:06:20 [auto1.it] INFO: Scrape type for NS64988: 2
2026-03-28 09:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe4dec7-0040-5612-837b-a06b62bef1cb with identifier: NS64988
2026-03-28 09:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe4dec7-0040-5612-837b-a06b62bef1cb with scrape type 2
2026-03-28 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe4dec7-0040-5612-837b-a06b62bef1cb with scrape type 2
2026-03-28 09:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: afe4dec7-0040-5612-837b-a06b62bef1cb, identifier: NS64988
2026-03-28 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC10641> (referer: https://www.auto1.com/v1/car-details-view/PC10641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC99655> (referer: https://www.auto1.com/v1/car-details-view/JC99655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_9f2b24a58ae97ed8c95e6a1d7c0ccb47.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: afe4dec7-0040-5612-837b-a06b62bef1cb with identifier: NS64988
2026-03-28 09:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: afe4dec7-0040-5612-837b-a06b62bef1cb with identifier: NS64988
2026-03-28 09:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: afe4dec7-0040-5612-837b-a06b62bef1cb with identifier: NS64988 to the API
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:14Z',
 'fuel_type': 'diesel',
 'id': 'afe4dec7-0040-5612-837b-a06b62bef1cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS64988',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 363757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'manual',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS64988%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Saving data for NS64988: {'auction_closing_time': 1774714034.0, 'created_time': 1771447890.471295, 'last_price_update_time': 1774688781.082041}
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NS64988') HTTP/1.1" 204 0
2026-03-28 09:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_f071deaaade5d6d73bdebd4ec76a64b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_f071deaaade5d6d73bdebd4ec76a64b1.jpg not downloaded yet
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: HT01283
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: HV13929
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV13929%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Scrape type for HV13929: 0
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: GV28161
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: AE80998
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: PD66788
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD66788%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Scrape type for PD66788: 0
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: EY62849
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62849%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Scrape type for EY62849: 0
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: LB25951
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB25951%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Scrape type for LB25951: 0
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: MJ44765
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: TM47514
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM47514%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Scrape type for TM47514: 0
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: CE18152
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: ER01593
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER01593%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Scrape type for ER01593: 2
2026-03-28 09:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd0fbae2-c59f-5f17-b7a8-4a6674909922 with identifier: ER01593
2026-03-28 09:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd0fbae2-c59f-5f17-b7a8-4a6674909922 with scrape type 2
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd0fbae2-c59f-5f17-b7a8-4a6674909922 with scrape type 2
2026-03-28 09:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd0fbae2-c59f-5f17-b7a8-4a6674909922, identifier: ER01593
2026-03-28 09:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE49798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd0fbae2-c59f-5f17-b7a8-4a6674909922 with identifier: ER01593
2026-03-28 09:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd0fbae2-c59f-5f17-b7a8-4a6674909922 with identifier: ER01593
2026-03-28 09:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd0fbae2-c59f-5f17-b7a8-4a6674909922 with identifier: ER01593 to the API
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:00Z',
 'fuel_type': 'diesel',
 'id': 'bd0fbae2-c59f-5f17-b7a8-4a6674909922',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER01593',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 147903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER01593%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Saving data for ER01593: {'auction_closing_time': 1774716180.0, 'created_time': 1771447202.130575, 'last_price_update_time': 1774688781.662528}
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ER01593') HTTP/1.1" 204 0
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_628d44c566e6d0fb1a87bfb1ee071983.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_628d44c566e6d0fb1a87bfb1ee071983.jpg not downloaded yet
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: PN94289
2026-03-28 09:06:21 [auto1.it] INFO: Found listing with ID: YY00281
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY00281%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [auto1.it] INFO: Scrape type for YY00281: 2
2026-03-28 09:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc51c1c-487a-5916-8b01-97da479b74ce with identifier: YY00281
2026-03-28 09:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc51c1c-487a-5916-8b01-97da479b74ce with scrape type 2
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cc51c1c-487a-5916-8b01-97da479b74ce with scrape type 2
2026-03-28 09:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0cc51c1c-487a-5916-8b01-97da479b74ce, identifier: YY00281
2026-03-28 09:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641
2026-03-28 09:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a84ad904-aa71-56f3-b2cf-dd74edb750d3 with scrape type 1
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a84ad904-aa71-56f3-b2cf-dd74edb750d3
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_316cfedc46118440a6632c4b72224816.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_316cfedc46118440a6632c4b72224816.jpg already downloaded
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_b0f1433520130f124db7a476a5206b8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_b0f1433520130f124db7a476a5206b8e.jpg already downloaded
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_df9223dd095b69277c56cd44dc21f044.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_df9223dd095b69277c56cd44dc21f044.jpg already downloaded
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_15564ae8e101e0d7c73a6d4e85c64b92.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_15564ae8e101e0d7c73a6d4e85c64b92.jpg already downloaded
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_ca292a546e93ca256b4a32a1acf75990.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_ca292a546e93ca256b4a32a1acf75990.jpg already downloaded
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_f5c889df7cc8c4e93b98fc6a8a12004a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_f5c889df7cc8c4e93b98fc6a8a12004a.jpg already downloaded
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_61014e0e9cebd7b30958f71c58323bcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_61014e0e9cebd7b30958f71c58323bcb.jpg already downloaded
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_872fac916d8711428db6dea1c53e1ec0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_872fac916d8711428db6dea1c53e1ec0.jpg already downloaded
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_8585805c3f640b213a1f8871dd2aaeb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_8585805c3f640b213a1f8871dd2aaeb2.jpg already downloaded
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F77%252Ff17765791ca1247fe4ddc728cc275b48%252Fpa%252FPC10641_53b076221079517cce56194dddf18a98.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_53b076221079517cce56194dddf18a98.jpg already downloaded
2026-03-28 09:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a84ad904-aa71-56f3-b2cf-dd74edb750d3, identifier: PC10641
2026-03-28 09:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655
2026-03-28 09:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59152a20-03e5-5c53-8083-4eb282cea514 with scrape type 1
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_dc3e654815b92ed4ef62321035f7f4c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_dc3e654815b92ed4ef62321035f7f4c5.jpg not downloaded yet
2026-03-28 09:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0659b5d0>
2026-03-28 09:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_9f2b24a58ae97ed8c95e6a1d7c0ccb47.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_9f2b24a58ae97ed8c95e6a1d7c0ccb47.jpg saved to cache
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0cc51c1c-487a-5916-8b01-97da479b74ce with identifier: YY00281
2026-03-28 09:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0cc51c1c-487a-5916-8b01-97da479b74ce with identifier: YY00281
2026-03-28 09:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0cc51c1c-487a-5916-8b01-97da479b74ce with identifier: YY00281 to the API
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:10:54Z',
 'fuel_type': 'petrol',
 'id': '0cc51c1c-487a-5916-8b01-97da479b74ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY00281',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 14143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-08',
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY00281%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [auto1.it] INFO: Saving data for YY00281: {'auction_closing_time': 1774714254.0, 'created_time': 1773130291.638993, 'last_price_update_time': 1774688782.555809}
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY00281') HTTP/1.1" 204 0
2026-03-28 09:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641
2026-03-28 09:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641
2026-03-28 09:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641 to the API
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC10641>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:28Z',
 'fuel_type': 'diesel',
 'id': 'a84ad904-aa71-56f3-b2cf-dd74edb750d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC10641',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 145304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_316cfedc46118440a6632c4b72224816.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_b0f1433520130f124db7a476a5206b8e.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_df9223dd095b69277c56cd44dc21f044.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_15564ae8e101e0d7c73a6d4e85c64b92.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_ca292a546e93ca256b4a32a1acf75990.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_f5c889df7cc8c4e93b98fc6a8a12004a.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_61014e0e9cebd7b30958f71c58323bcb.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_872fac916d8711428db6dea1c53e1ec0.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_8585805c3f640b213a1f8871dd2aaeb2.jpg',
                'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_53b076221079517cce56194dddf18a98.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_316cfedc46118440a6632c4b72224816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_b0f1433520130f124db7a476a5206b8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_df9223dd095b69277c56cd44dc21f044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_15564ae8e101e0d7c73a6d4e85c64b92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_ca292a546e93ca256b4a32a1acf75990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_f5c889df7cc8c4e93b98fc6a8a12004a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_61014e0e9cebd7b30958f71c58323bcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_872fac916d8711428db6dea1c53e1ec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_8585805c3f640b213a1f8871dd2aaeb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a84ad904-aa71-56f3-b2cf-dd74edb750d3/a84ad904-aa71-56f3-b2cf-dd74edb750d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/77/f17765791ca1247fe4ddc728cc275b48/pa/PC10641_53b076221079517cce56194dddf18a98.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10641%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [auto1.it] INFO: Saving data for PC10641: {'created_time': 1774688782.888622, 'last_price_update_time': 1774688782.888631, 'auction_closing_time': 1774883248.0}
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PC10641') HTTP/1.1" 204 0
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_13629832d7ef77881efa104328e6793e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_13629832d7ef77881efa104328e6793e.jpg not downloaded yet
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR28230%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [auto1.it] INFO: Scrape type for UR28230: 0
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE38738%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [auto1.it] INFO: Scrape type for YE38738: 0
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: AT20318
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: KZ05620
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: FC17087
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD48597%27 HTTP/1.1" 200 None
2026-03-28 09:06:22 [auto1.it] INFO: Scrape type for CD48597: 0
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: ML74945
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: SD37804
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: LR48777
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: GU75904
2026-03-28 09:06:22 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-28 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK43313%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for WK43313: 0
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK04078%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for BK04078: 0
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: XY04064
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY04064%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for XY04064: 0
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: ML03059
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL86512%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for SL86512: 0
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE91281%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for EE91281: 0
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC62247%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for DC62247: 0
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF61265%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for MF61265: 0
2026-03-28 09:06:23 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW72001%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [auto1.it] INFO: Scrape type for UW72001: 0
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_acde37500dc8226b1e5b9e69cfa674d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_acde37500dc8226b1e5b9e69cfa674d2.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_50246d3b4059c0910576b71148bd4843.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_50246d3b4059c0910576b71148bd4843.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_242ba3e472de347865968632d67166a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_242ba3e472de347865968632d67166a8.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_5ee5bf504183b58f48bcc846a543b221.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_5ee5bf504183b58f48bcc846a543b221.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_53e85866da250d6fef2426d55ae5c8a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_53e85866da250d6fef2426d55ae5c8a0.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_3577eba7d5046efc6cd7ac9b9fd193bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_3577eba7d5046efc6cd7ac9b9fd193bb.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_be5c1fd0b174a47b22708166bdfdaa2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_be5c1fd0b174a47b22708166bdfdaa2a.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_97c0e96318b3246af87387e19c02036c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_97c0e96318b3246af87387e19c02036c.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_5786d43b7a2378e74a67d3241868e677.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_5786d43b7a2378e74a67d3241868e677.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_2ab751d2a35442a50f2f88f2b884875c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_2ab751d2a35442a50f2f88f2b884875c.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_58dd103417b2a86d2cfefabb06a6cd5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_58dd103417b2a86d2cfefabb06a6cd5a.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_ff2400f92b743f68d39e5d1dbfed7b56.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_ff2400f92b743f68d39e5d1dbfed7b56.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_965d34fe16fc510f642c6b8802cf14c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_965d34fe16fc510f642c6b8802cf14c3.jpg not downloaded yet
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_4bcdf9febef97c893cc4ebc4d0c5f9a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_4bcdf9febef97c893cc4ebc4d0c5f9a0.jpg not downloaded yet
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_17c0b87a273e91937bb984964e3820be.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a182c9457aa2dc7d65147c5d0cba3930.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_137949ade0e4dfc237a6ace07190f215.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_71686608b11ee5b9c2d181a758e2a71a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_fbe2579d686b45657ef37c96ad31f368.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_2863a10ade0d116442aa4df883e81f04.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_b408f8973fe2a2584d1de5f673d582d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a39767645dec3b7f45dba4753769b2cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_71754aa83f08bcea30ad2301d96963ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c098890>
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_17c0b87a273e91937bb984964e3820be.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_17c0b87a273e91937bb984964e3820be.jpg saved to cache
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_4bcdf9febef97c893cc4ebc4d0c5f9a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_f071deaaade5d6d73bdebd4ec76a64b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0bc210>
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_a182c9457aa2dc7d65147c5d0cba3930.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a182c9457aa2dc7d65147c5d0cba3930.jpg saved to cache
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d890090>
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_137949ade0e4dfc237a6ace07190f215.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_137949ade0e4dfc237a6ace07190f215.jpg saved to cache
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d87aed0>
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_71686608b11ee5b9c2d181a758e2a71a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_71686608b11ee5b9c2d181a758e2a71a.jpg saved to cache
2026-03-28 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c062492d0>
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_fbe2579d686b45657ef37c96ad31f368.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_fbe2579d686b45657ef37c96ad31f368.jpg saved to cache
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d891510>
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fba%252F05ba8879b867653c51af461aa30bb08d%252Fpa%252FRX70685_2863a10ade0d116442aa4df883e81f04.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_2863a10ade0d116442aa4df883e81f04.jpg saved to cache
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdbf227c-bd50-5928-800a-c959a597da67
2026-03-28 09:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdbf227c-bd50-5928-800a-c959a597da67, skipping ID generation
2026-03-28 09:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdbf227c-bd50-5928-800a-c959a597da67 with scrape type 1
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdbf227c-bd50-5928-800a-c959a597da67 sending to next pipeline
2026-03-28 09:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fdbf227c-bd50-5928-800a-c959a597da67, identifier: RX70685
2026-03-28 09:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0675c6d0>
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_b408f8973fe2a2584d1de5f673d582d7.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_b408f8973fe2a2584d1de5f673d582d7.jpg saved to cache
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c1b4e6050>
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_a39767645dec3b7f45dba4753769b2cc.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a39767645dec3b7f45dba4753769b2cc.jpg saved to cache
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0e3b10>
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_71754aa83f08bcea30ad2301d96963ef.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_71754aa83f08bcea30ad2301d96963ef.jpg saved to cache
2026-03-28 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685
2026-03-28 09:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685
2026-03-28 09:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685 to the API
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_2863a10ade0d116442aa4df883e81f04.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:37:25Z',
 'fuel_type': 'petrol',
 'id': 'fdbf227c-bd50-5928-800a-c959a597da67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX70685',
 'listing': 'auction',
 'location': 'IT, Beinasco',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 173164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_35c2442a9960cdb25dccf265e037db2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_56cca9b816dacfe4ec7bfeca56f11389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_3edc1929974a58cba795344f249cfb51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_1cd2d705806e4c47fbe30b699daf7a33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_95d5946bae3ff1ed30335bcef762438c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_05ca527d5f86d5333b6a6565cd92aa73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_7e74298a7a63e6dd6297e4c887c6ce99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_97953ad1b5851757dd0a1eab2cc9bca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2601262,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_2863a10ade0d116442aa4df883e81f04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbf227c-bd50-5928-800a-c959a597da67/fdbf227c-bd50-5928-800a-c959a597da67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/ba/05ba8879b867653c51af461aa30bb08d/pa/RX70685_9f2b24a58ae97ed8c95e6a1d7c0ccb47.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-28 09:06:24 [auto1.it] INFO: Saving data for RX70685: {'created_time': 1774688784.909646, 'last_price_update_time': 1774688784.909656, 'auction_closing_time': 1774885045.0}
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX70685') HTTP/1.1" 204 0
2026-03-28 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG70821> (referer: https://www.auto1.com/v1/car-details-view/LG70821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR24813> (referer: https://www.auto1.com/v1/car-details-view/KR24813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR54078> (referer: https://www.auto1.com/v1/car-details-view/TR54078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK55043> (referer: https://www.auto1.com/v1/car-details-view/DK55043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW75734/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065e2ed0>
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_4bcdf9febef97c893cc4ebc4d0c5f9a0.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_4bcdf9febef97c893cc4ebc4d0c5f9a0.jpg saved to cache
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061efa10>
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_f071deaaade5d6d73bdebd4ec76a64b1.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_f071deaaade5d6d73bdebd4ec76a64b1.jpg saved to cache
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821
2026-03-28 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with scrape type 1
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_235d495e96784574477bbca9f830ee22.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_235d495e96784574477bbca9f830ee22.jpg not downloaded yet
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_f011bac8535244356787afbe67bd3153.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_f011bac8535244356787afbe67bd3153.jpg not downloaded yet
2026-03-28 09:06:25 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813
2026-03-28 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 688ac3ea-4c1c-578a-b56b-7bd327a99640 with scrape type 1
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 688ac3ea-4c1c-578a-b56b-7bd327a99640
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_1435478d67bca9ac48cdd04860116697.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_1435478d67bca9ac48cdd04860116697.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_5755b6a3ba61181701845222148f90b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_5755b6a3ba61181701845222148f90b1.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_e3361e9a2ee10c4c5a3895627c0ec216.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_e3361e9a2ee10c4c5a3895627c0ec216.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_93f28cade06fa92bf82316347eeca932.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_93f28cade06fa92bf82316347eeca932.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_4f57fa9f07ef91295bcce52448a989e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_4f57fa9f07ef91295bcce52448a989e0.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_adae9462387bb26945a0caa7edfbf6cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_adae9462387bb26945a0caa7edfbf6cf.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_b1d4c6f4d9b96ff5c48b5f6b650f36ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_b1d4c6f4d9b96ff5c48b5f6b650f36ba.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_3e2742fcef90974e320d4fe826daaf08.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_3e2742fcef90974e320d4fe826daaf08.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_f68de1ea868931db72f366e331c0c959.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_f68de1ea868931db72f366e331c0c959.jpg already downloaded
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F2a%252F472a152279e6f1effc0d67fade8440db%252Fpa%252FKR24813_0c30c704755fac0304419b529721028e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_0c30c704755fac0304419b529721028e.jpg already downloaded
2026-03-28 09:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 688ac3ea-4c1c-578a-b56b-7bd327a99640, identifier: KR24813
2026-03-28 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078
2026-03-28 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74849f8d-da12-56ab-abe2-9e9955a6aed6 with scrape type 1
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 74849f8d-da12-56ab-abe2-9e9955a6aed6
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_a77ba7c013a94f60fbf7b01287291f0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_a77ba7c013a94f60fbf7b01287291f0d.jpg not downloaded yet
2026-03-28 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043
2026-03-28 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e033872-a83b-5cff-98e9-c5694592bad3 with scrape type 1
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5e033872-a83b-5cff-98e9-c5694592bad3
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_df14a2440c6bd9f9c6525535810bc464.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_df14a2440c6bd9f9c6525535810bc464.jpg not downloaded yet
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_aec5c383a994faacdafee3ca74f7b615.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_aec5c383a994faacdafee3ca74f7b615.jpg not downloaded yet
2026-03-28 09:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813
2026-03-28 09:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813
2026-03-28 09:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813 to the API
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR24813>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:06:03Z',
 'fuel_type': 'diesel',
 'id': '688ac3ea-4c1c-578a-b56b-7bd327a99640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR24813',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'BMW',
 'model': '3er',
 'odometer': 97558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_1435478d67bca9ac48cdd04860116697.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_5755b6a3ba61181701845222148f90b1.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_e3361e9a2ee10c4c5a3895627c0ec216.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_93f28cade06fa92bf82316347eeca932.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_4f57fa9f07ef91295bcce52448a989e0.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_adae9462387bb26945a0caa7edfbf6cf.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_b1d4c6f4d9b96ff5c48b5f6b650f36ba.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_3e2742fcef90974e320d4fe826daaf08.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_f68de1ea868931db72f366e331c0c959.jpg',
                'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_0c30c704755fac0304419b529721028e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_1435478d67bca9ac48cdd04860116697.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_5755b6a3ba61181701845222148f90b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2035213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_e3361e9a2ee10c4c5a3895627c0ec216.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_93f28cade06fa92bf82316347eeca932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_4f57fa9f07ef91295bcce52448a989e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1925932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_adae9462387bb26945a0caa7edfbf6cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_b1d4c6f4d9b96ff5c48b5f6b650f36ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_3e2742fcef90974e320d4fe826daaf08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_f68de1ea868931db72f366e331c0c959.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688ac3ea-4c1c-578a-b56b-7bd327a99640/688ac3ea-4c1c-578a-b56b-7bd327a99640_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/2a/472a152279e6f1effc0d67fade8440db/pa/KR24813_0c30c704755fac0304419b529721028e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR24813%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [auto1.it] INFO: Saving data for KR24813: {'created_time': 1774688785.893629, 'last_price_update_time': 1774688785.893639, 'auction_closing_time': 1774883163.0}
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR24813') HTTP/1.1" 204 0
2026-03-28 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_3577eba7d5046efc6cd7ac9b9fd193bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: DS35304
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS35304%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [auto1.it] INFO: Scrape type for DS35304: 0
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: PK48399
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK48399%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [auto1.it] INFO: Scrape type for PK48399: 0
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: SH43932
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: BG88310
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG88310%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [auto1.it] INFO: Scrape type for BG88310: 0
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: GC37992
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC37992%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [auto1.it] INFO: Scrape type for GC37992: 0
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM17769%27 HTTP/1.1" 200 None
2026-03-28 09:06:25 [auto1.it] INFO: Scrape type for UM17769: 0
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: BE55711
2026-03-28 09:06:25 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL42775%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for DL42775: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18213%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for YG18213: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD20323%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for KD20323: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY53013%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for FY53013: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11225%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for CA11225: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG27793%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for LG27793: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16338%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for GT16338: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV42889%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for WV42889: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD88975%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for BD88975: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: XS44510
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS44510%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for XS44510: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: GK30834
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM41534%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for LM41534: 0
2026-03-28 09:06:26 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV91656%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [auto1.it] INFO: Scrape type for WV91656: 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_6c5a713715f0cb5fbb7bd3587f98af87.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_6c5a713715f0cb5fbb7bd3587f98af87.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_811b5afbc41b910bd67c3789bec4fa59.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_811b5afbc41b910bd67c3789bec4fa59.jpg not downloaded yet
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_965d34fe16fc510f642c6b8802cf14c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_97c0e96318b3246af87387e19c02036c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_be5c1fd0b174a47b22708166bdfdaa2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_2ab751d2a35442a50f2f88f2b884875c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_5786d43b7a2378e74a67d3241868e677.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_ff2400f92b743f68d39e5d1dbfed7b56.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_74b77543f08005abd2e751c00502abe5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_74b77543f08005abd2e751c00502abe5.jpg not downloaded yet
2026-03-28 09:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_72b8ca22b331a1d19670fc61c139d781.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_72b8ca22b331a1d19670fc61c139d781.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_04decf92996a09e5c00c01807f656c99.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_04decf92996a09e5c00c01807f656c99.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_ceaa546d814338e59019b83acf121d4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_ceaa546d814338e59019b83acf121d4d.jpg not downloaded yet
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c24a8d0>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_3577eba7d5046efc6cd7ac9b9fd193bb.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_3577eba7d5046efc6cd7ac9b9fd193bb.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_d8e65083b0156bfadd07546ee67088c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_d8e65083b0156bfadd07546ee67088c7.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_17c589457253b763762067d65e95e011.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_17c589457253b763762067d65e95e011.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_daf027ff8a78ea8dfce33af9ae733db4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_daf027ff8a78ea8dfce33af9ae733db4.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_47a9920e760552cee1c1346c7605d7b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_47a9920e760552cee1c1346c7605d7b5.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_dfdc8a0cae5a599896836991e4f22f43.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_dfdc8a0cae5a599896836991e4f22f43.jpg not downloaded yet
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06215110>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_965d34fe16fc510f642c6b8802cf14c3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_965d34fe16fc510f642c6b8802cf14c3.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2d2150>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_97c0e96318b3246af87387e19c02036c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_97c0e96318b3246af87387e19c02036c.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06276110>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_be5c1fd0b174a47b22708166bdfdaa2a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_be5c1fd0b174a47b22708166bdfdaa2a.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066bb5d0>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_2ab751d2a35442a50f2f88f2b884875c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_2ab751d2a35442a50f2f88f2b884875c.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065d3910>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_5786d43b7a2378e74a67d3241868e677.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_5786d43b7a2378e74a67d3241868e677.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c192650>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_ff2400f92b743f68d39e5d1dbfed7b56.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_ff2400f92b743f68d39e5d1dbfed7b56.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_45acfae2e5f9fb0e052763b13977ed1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_45acfae2e5f9fb0e052763b13977ed1e.jpg not downloaded yet
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_53e85866da250d6fef2426d55ae5c8a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_5ee5bf504183b58f48bcc846a543b221.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_dc3e654815b92ed4ef62321035f7f4c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_50246d3b4059c0910576b71148bd4843.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_13629832d7ef77881efa104328e6793e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_242ba3e472de347865968632d67166a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_68f2d9a291ce0faf127a59a1660c0f0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_68f2d9a291ce0faf127a59a1660c0f0e.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_8a16753c27a338b867ffcace67e4580d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_8a16753c27a338b867ffcace67e4580d.jpg not downloaded yet
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_a2cd8cc7860451cd9b524253ab935e43.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_a2cd8cc7860451cd9b524253ab935e43.jpg not downloaded yet
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_235d495e96784574477bbca9f830ee22.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_df14a2440c6bd9f9c6525535810bc464.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_58dd103417b2a86d2cfefabb06a6cd5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_a77ba7c013a94f60fbf7b01287291f0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_acde37500dc8226b1e5b9e69cfa674d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066c0550>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_53e85866da250d6fef2426d55ae5c8a0.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_53e85866da250d6fef2426d55ae5c8a0.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_d8e65083b0156bfadd07546ee67088c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1a59d0>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_5ee5bf504183b58f48bcc846a543b221.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_5ee5bf504183b58f48bcc846a543b221.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06602b90>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_dc3e654815b92ed4ef62321035f7f4c5.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_dc3e654815b92ed4ef62321035f7f4c5.jpg saved to cache
2026-03-28 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067bd410>
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_50246d3b4059c0910576b71148bd4843.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_50246d3b4059c0910576b71148bd4843.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0659ef90>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_13629832d7ef77881efa104328e6793e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_13629832d7ef77881efa104328e6793e.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066e0410>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_242ba3e472de347865968632d67166a8.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_242ba3e472de347865968632d67166a8.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_f011bac8535244356787afbe67bd3153.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_45acfae2e5f9fb0e052763b13977ed1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_dfdc8a0cae5a599896836991e4f22f43.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_17c589457253b763762067d65e95e011.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_aec5c383a994faacdafee3ca74f7b615.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_47a9920e760552cee1c1346c7605d7b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0d5d50>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_235d495e96784574477bbca9f830ee22.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_235d495e96784574477bbca9f830ee22.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0a6190>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_df14a2440c6bd9f9c6525535810bc464.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_df14a2440c6bd9f9c6525535810bc464.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e033872-a83b-5cff-98e9-c5694592bad3
2026-03-28 09:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1fbb10>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_58dd103417b2a86d2cfefabb06a6cd5a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_58dd103417b2a86d2cfefabb06a6cd5a.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db4f5d0>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_a77ba7c013a94f60fbf7b01287291f0d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_a77ba7c013a94f60fbf7b01287291f0d.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74849f8d-da12-56ab-abe2-9e9955a6aed6
2026-03-28 09:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067d0a90>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa9%252F11a9ab811f936a2a6d5c8a721ed783e1%252Fpa%252FJC99655_acde37500dc8226b1e5b9e69cfa674d2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_acde37500dc8226b1e5b9e69cfa674d2.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59152a20-03e5-5c53-8083-4eb282cea514
2026-03-28 09:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59152a20-03e5-5c53-8083-4eb282cea514, skipping ID generation
2026-03-28 09:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59152a20-03e5-5c53-8083-4eb282cea514 with scrape type 1
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59152a20-03e5-5c53-8083-4eb282cea514 sending to next pipeline
2026-03-28 09:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 59152a20-03e5-5c53-8083-4eb282cea514, identifier: JC99655
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0d49d0>
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_d8e65083b0156bfadd07546ee67088c7.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_d8e65083b0156bfadd07546ee67088c7.jpg saved to cache
2026-03-28 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74849f8d-da12-56ab-abe2-9e9955a6aed6
2026-03-28 09:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655
2026-03-28 09:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655
2026-03-28 09:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655 to the API
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_acde37500dc8226b1e5b9e69cfa674d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:07Z',
 'fuel_type': 'diesel',
 'id': '59152a20-03e5-5c53-8083-4eb282cea514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC99655',
 'listing': 'auction',
 'location': 'IT, Navacchio',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 141796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_dc3e654815b92ed4ef62321035f7f4c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_acde37500dc8226b1e5b9e69cfa674d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_242ba3e472de347865968632d67166a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_53e85866da250d6fef2426d55ae5c8a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_be5c1fd0b174a47b22708166bdfdaa2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_5786d43b7a2378e74a67d3241868e677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_58dd103417b2a86d2cfefabb06a6cd5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_ff2400f92b743f68d39e5d1dbfed7b56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_965d34fe16fc510f642c6b8802cf14c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59152a20-03e5-5c53-8083-4eb282cea514/59152a20-03e5-5c53-8083-4eb282cea514_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a9/11a9ab811f936a2a6d5c8a721ed783e1/pa/JC99655_4bcdf9febef97c893cc4ebc4d0c5f9a0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2016}
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC99655%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [auto1.it] INFO: Saving data for JC99655: {'created_time': 1774688788.032365, 'last_price_update_time': 1774688788.032377, 'auction_closing_time': 1774886287.0}
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC99655') HTTP/1.1" 204 0
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_ceaa546d814338e59019b83acf121d4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_8a16753c27a338b867ffcace67e4580d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_68f2d9a291ce0faf127a59a1660c0f0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE49798> (referer: https://www.auto1.com/v1/car-details-view/YE49798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW75734> (referer: https://www.auto1.com/v1/car-details-view/SW75734/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065a1390>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_f011bac8535244356787afbe67bd3153.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_f011bac8535244356787afbe67bd3153.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0fac10>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_45acfae2e5f9fb0e052763b13977ed1e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_45acfae2e5f9fb0e052763b13977ed1e.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06799410>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_dfdc8a0cae5a599896836991e4f22f43.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_dfdc8a0cae5a599896836991e4f22f43.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e033872-a83b-5cff-98e9-c5694592bad3
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d864f90>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_17c589457253b763762067d65e95e011.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_17c589457253b763762067d65e95e011.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e033872-a83b-5cff-98e9-c5694592bad3
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0fb7d0>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_aec5c383a994faacdafee3ca74f7b615.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_aec5c383a994faacdafee3ca74f7b615.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0652c890>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_47a9920e760552cee1c1346c7605d7b5.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_47a9920e760552cee1c1346c7605d7b5.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74849f8d-da12-56ab-abe2-9e9955a6aed6
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_811b5afbc41b910bd67c3789bec4fa59.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_74b77543f08005abd2e751c00502abe5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_628d44c566e6d0fb1a87bfb1ee071983.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_04decf92996a09e5c00c01807f656c99.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_72b8ca22b331a1d19670fc61c139d781.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_6c5a713715f0cb5fbb7bd3587f98af87.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0f95d0>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_ceaa546d814338e59019b83acf121d4d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_ceaa546d814338e59019b83acf121d4d.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06739790>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_8a16753c27a338b867ffcace67e4580d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_8a16753c27a338b867ffcace67e4580d.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065e6250>
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_68f2d9a291ce0faf127a59a1660c0f0e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_68f2d9a291ce0faf127a59a1660c0f0e.jpg saved to cache
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798
2026-03-28 09:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e70bfe3-326a-59c3-bf90-656e01b615c2 with scrape type 1
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e70bfe3-326a-59c3-bf90-656e01b615c2
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_ba46d56fd752debb04672c0a3946f287.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_ba46d56fd752debb04672c0a3946f287.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_d30f6997c604916f4d673feb4fd0b6d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_d30f6997c604916f4d673feb4fd0b6d3.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_8bd3c51b618883cbe35e613b67b5f0c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_8bd3c51b618883cbe35e613b67b5f0c0.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_d2488d76fb89d223ab82c12e121332ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_d2488d76fb89d223ab82c12e121332ab.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_5da8f03d2dfd642023d8031567c5e0d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_5da8f03d2dfd642023d8031567c5e0d9.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_2e35dcbb75654809a644df8406f383bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_2e35dcbb75654809a644df8406f383bc.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_eb3a5eedd45587613fea0fb3b656a4dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_eb3a5eedd45587613fea0fb3b656a4dc.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_93f4632ed1495e7def45492461d5b864.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_93f4632ed1495e7def45492461d5b864.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_9534fb5b70f7aca1454af521a457b051.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_9534fb5b70f7aca1454af521a457b051.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7f%252F997f6ce779f1fa3e59487c97732449a9%252Fpa%252FYE49798_87625a8afc468313604f78ec2393c058.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_87625a8afc468313604f78ec2393c058.jpg already downloaded
2026-03-28 09:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e70bfe3-326a-59c3-bf90-656e01b615c2, identifier: YE49798
2026-03-28 09:06:28 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734
2026-03-28 09:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd326e37-9ee5-51ed-958e-cbeba9f9d3af with scrape type 1
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cd326e37-9ee5-51ed-958e-cbeba9f9d3af
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F56%252Fe056e92684ed9139d0caccee6d91d66a%252Fpa%252FSW75734_a0456b09728b2d41d06785db927704cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_a0456b09728b2d41d06785db927704cf.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F56%252Fe056e92684ed9139d0caccee6d91d66a%252Fpa%252FSW75734_d9df969ad0681a410d5e70db153d65c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_d9df969ad0681a410d5e70db153d65c8.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F56%252Fe056e92684ed9139d0caccee6d91d66a%252Fpa%252FSW75734_ecb5e9000ca0aef407cb02945ad560cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_ecb5e9000ca0aef407cb02945ad560cc.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F56%252Fe056e92684ed9139d0caccee6d91d66a%252Fpa%252FSW75734_8ce1382592e53d0e320b20c8d74bc3e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_8ce1382592e53d0e320b20c8d74bc3e9.jpg already downloaded
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F56%252Fe056e92684ed9139d0caccee6d91d66a%252Fpa%252FSW75734_1bc2ce83d21ecf154d38bc5d795c0f16.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_1bc2ce83d21ecf154d38bc5d795c0f16.jpg already downloaded
2026-03-28 09:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd326e37-9ee5-51ed-958e-cbeba9f9d3af, identifier: SW75734
2026-03-28 09:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798
2026-03-28 09:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798
2026-03-28 09:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798 to the API
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE49798>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:07Z',
 'fuel_type': 'diesel',
 'id': '4e70bfe3-326a-59c3-bf90-656e01b615c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE49798',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 117555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_ba46d56fd752debb04672c0a3946f287.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_d30f6997c604916f4d673feb4fd0b6d3.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_8bd3c51b618883cbe35e613b67b5f0c0.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_d2488d76fb89d223ab82c12e121332ab.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_5da8f03d2dfd642023d8031567c5e0d9.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_2e35dcbb75654809a644df8406f383bc.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_eb3a5eedd45587613fea0fb3b656a4dc.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_93f4632ed1495e7def45492461d5b864.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_9534fb5b70f7aca1454af521a457b051.jpg',
                'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_87625a8afc468313604f78ec2393c058.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_ba46d56fd752debb04672c0a3946f287.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_d30f6997c604916f4d673feb4fd0b6d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_8bd3c51b618883cbe35e613b67b5f0c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_d2488d76fb89d223ab82c12e121332ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_5da8f03d2dfd642023d8031567c5e0d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_2e35dcbb75654809a644df8406f383bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_eb3a5eedd45587613fea0fb3b656a4dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_93f4632ed1495e7def45492461d5b864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_9534fb5b70f7aca1454af521a457b051.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e70bfe3-326a-59c3-bf90-656e01b615c2/4e70bfe3-326a-59c3-bf90-656e01b615c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7f/997f6ce779f1fa3e59487c97732449a9/pa/YE49798_87625a8afc468313604f78ec2393c058.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE49798%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Saving data for YE49798: {'created_time': 1774688789.341924, 'last_price_update_time': 1774688789.341934, 'auction_closing_time': 1774886287.0}
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE49798') HTTP/1.1" 204 0
2026-03-28 09:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734
2026-03-28 09:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734
2026-03-28 09:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734 to the API
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW75734>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:27:43Z',
 'fuel_type': 'petrol',
 'id': 'cd326e37-9ee5-51ed-958e-cbeba9f9d3af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW75734',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 85791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_a0456b09728b2d41d06785db927704cf.jpg',
                'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_d9df969ad0681a410d5e70db153d65c8.jpg',
                'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_ecb5e9000ca0aef407cb02945ad560cc.jpg',
                'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_8ce1382592e53d0e320b20c8d74bc3e9.jpg',
                'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_1bc2ce83d21ecf154d38bc5d795c0f16.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd326e37-9ee5-51ed-958e-cbeba9f9d3af/cd326e37-9ee5-51ed-958e-cbeba9f9d3af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_a0456b09728b2d41d06785db927704cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd326e37-9ee5-51ed-958e-cbeba9f9d3af/cd326e37-9ee5-51ed-958e-cbeba9f9d3af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_d9df969ad0681a410d5e70db153d65c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd326e37-9ee5-51ed-958e-cbeba9f9d3af/cd326e37-9ee5-51ed-958e-cbeba9f9d3af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_ecb5e9000ca0aef407cb02945ad560cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd326e37-9ee5-51ed-958e-cbeba9f9d3af/cd326e37-9ee5-51ed-958e-cbeba9f9d3af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_8ce1382592e53d0e320b20c8d74bc3e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd326e37-9ee5-51ed-958e-cbeba9f9d3af/cd326e37-9ee5-51ed-958e-cbeba9f9d3af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/56/e056e92684ed9139d0caccee6d91d66a/pa/SW75734_1bc2ce83d21ecf154d38bc5d795c0f16.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Modus 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW75734%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Saving data for SW75734: {'created_time': 1774688789.678129, 'last_price_update_time': 1774688789.678139, 'auction_closing_time': 1774884463.0}
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SW75734') HTTP/1.1" 204 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS14469%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for CS14469: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW89993%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for DW89993: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: LE38713
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: SE41207
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE41207%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for SE41207: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ91749%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for XJ91749: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH06276%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for WH06276: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: MC37024
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: BG56608
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK89859%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for MK89859: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: EU22988
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY59830%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for LY59830: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC45028%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for DC45028: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ48642%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for EZ48642: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: VE78842
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE78842%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for VE78842: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY14439%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for NY14439: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: VS64028
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS64028%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for VS64028: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC44140%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for VC44140: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86126%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for GM86126: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24825%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for UZ24825: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF82865%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for AF82865: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: TE63682
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH43496%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for NH43496: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: EA01754
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA01754%27 HTTP/1.1" 200 None
2026-03-28 09:06:29 [auto1.it] INFO: Scrape type for EA01754: 0
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-28 09:06:29 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA58857%27 HTTP/1.1" 200 None
2026-03-28 09:06:30 [auto1.it] INFO: Scrape type for GA58857: 0
2026-03-28 09:06:30 [auto1.it] INFO: Found listing with ID: XK51996
2026-03-28 09:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_ab676d57f8feee3e8df8fbbfc0039a87.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_28e3b079f16fdb4456d10fc0f6080469.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_3bd04a205ec667a4393ae0c463968522.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e8dfb26ffe07b103eff940636a69e7db.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_eca4f3d3af907471deb3b7e3baf3661c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0e3ed0>
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_811b5afbc41b910bd67c3789bec4fa59.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_811b5afbc41b910bd67c3789bec4fa59.jpg saved to cache
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e033872-a83b-5cff-98e9-c5694592bad3
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0b28d0>
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_74b77543f08005abd2e751c00502abe5.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_74b77543f08005abd2e751c00502abe5.jpg saved to cache
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0c0650>
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_628d44c566e6d0fb1a87bfb1ee071983.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_628d44c566e6d0fb1a87bfb1ee071983.jpg saved to cache
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0659aa50>
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd6%252Fd1d6d8e42a1841ffc847b59f0a205c8d%252Fpa%252FDK55043_04decf92996a09e5c00c01807f656c99.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_04decf92996a09e5c00c01807f656c99.jpg saved to cache
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e033872-a83b-5cff-98e9-c5694592bad3
2026-03-28 09:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e033872-a83b-5cff-98e9-c5694592bad3, skipping ID generation
2026-03-28 09:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e033872-a83b-5cff-98e9-c5694592bad3 with scrape type 1
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e033872-a83b-5cff-98e9-c5694592bad3 sending to next pipeline
2026-03-28 09:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e033872-a83b-5cff-98e9-c5694592bad3, identifier: DK55043
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2d3690>
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_72b8ca22b331a1d19670fc61c139d781.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_72b8ca22b331a1d19670fc61c139d781.jpg saved to cache
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74849f8d-da12-56ab-abe2-9e9955a6aed6
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c036050>
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd3%252F94d3e2cdd950bf9fc0ce960600d461a9%252Fpa%252FTR54078_6c5a713715f0cb5fbb7bd3587f98af87.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_6c5a713715f0cb5fbb7bd3587f98af87.jpg saved to cache
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74849f8d-da12-56ab-abe2-9e9955a6aed6
2026-03-28 09:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74849f8d-da12-56ab-abe2-9e9955a6aed6, skipping ID generation
2026-03-28 09:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74849f8d-da12-56ab-abe2-9e9955a6aed6 with scrape type 1
2026-03-28 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74849f8d-da12-56ab-abe2-9e9955a6aed6 sending to next pipeline
2026-03-28 09:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74849f8d-da12-56ab-abe2-9e9955a6aed6, identifier: TR54078
2026-03-28 09:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043
2026-03-28 09:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043
2026-03-28 09:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043 to the API
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_04decf92996a09e5c00c01807f656c99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:45Z',
 'fuel_type': 'petrol',
 'id': '5e033872-a83b-5cff-98e9-c5694592bad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK55043',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 269349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_df14a2440c6bd9f9c6525535810bc464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_811b5afbc41b910bd67c3789bec4fa59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_04decf92996a09e5c00c01807f656c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_17c589457253b763762067d65e95e011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e033872-a83b-5cff-98e9-c5694592bad3/5e033872-a83b-5cff-98e9-c5694592bad3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d6/d1d6d8e42a1841ffc847b59f0a205c8d/pa/DK55043_dfdc8a0cae5a599896836991e4f22f43.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK55043%27 HTTP/1.1" 200 None
2026-03-28 09:06:30 [auto1.it] INFO: Saving data for DK55043: {'created_time': 1774688790.837686, 'last_price_update_time': 1774688790.8377, 'auction_closing_time': 1774884705.0}
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK55043') HTTP/1.1" 204 0
2026-03-28 09:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078
2026-03-28 09:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078
2026-03-28 09:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078 to the API
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_6c5a713715f0cb5fbb7bd3587f98af87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:50:48Z',
 'fuel_type': 'petrol',
 'id': '74849f8d-da12-56ab-abe2-9e9955a6aed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR54078',
 'listing': 'auction',
 'location': 'IT, Garbagnate Milanese',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 203784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_a77ba7c013a94f60fbf7b01287291f0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_6c5a713715f0cb5fbb7bd3587f98af87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_72b8ca22b331a1d19670fc61c139d781.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_d8e65083b0156bfadd07546ee67088c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74849f8d-da12-56ab-abe2-9e9955a6aed6/74849f8d-da12-56ab-abe2-9e9955a6aed6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d3/94d3e2cdd950bf9fc0ce960600d461a9/pa/TR54078_47a9920e760552cee1c1346c7605d7b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR54078%27 HTTP/1.1" 200 None
2026-03-28 09:06:31 [auto1.it] INFO: Saving data for TR54078: {'created_time': 1774688791.586156, 'last_price_update_time': 1774688791.586166, 'auction_closing_time': 1774885848.0}
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR54078') HTTP/1.1" 204 0
2026-03-28 09:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_756186ed86b2dd0b043558bf9397c114.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0659bed0>
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_ab676d57f8feee3e8df8fbbfc0039a87.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_ab676d57f8feee3e8df8fbbfc0039a87.jpg saved to cache
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0c2dd0>
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg saved to cache
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065fa290>
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F65%252Fe16524b657dbd96f1968c9922b84d35e%252Fpa%252FEP64063_28e3b079f16fdb4456d10fc0f6080469.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_28e3b079f16fdb4456d10fc0f6080469.jpg saved to cache
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056
2026-03-28 09:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056, skipping ID generation
2026-03-28 09:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with scrape type 1
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 sending to next pipeline
2026-03-28 09:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056, identifier: EP64063
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0b1b10>
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_3bd04a205ec667a4393ae0c463968522.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_3bd04a205ec667a4393ae0c463968522.jpg saved to cache
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3022335d-6f84-581b-b193-8873e4bbb075
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c217f50>
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdb%252F7ddbe139d6640446221138ca4767c9c6%252Fpa%252FCB28979_e8dfb26ffe07b103eff940636a69e7db.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e8dfb26ffe07b103eff940636a69e7db.jpg saved to cache
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b
2026-03-28 09:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b, skipping ID generation
2026-03-28 09:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with scrape type 1
2026-03-28 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b sending to next pipeline
2026-03-28 09:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b, identifier: CB28979
2026-03-28 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2159d0>
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_eca4f3d3af907471deb3b7e3baf3661c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_eca4f3d3af907471deb3b7e3baf3661c.jpg saved to cache
2026-03-28 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_03746f765219b945474a2598c334d8d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_17b3508d9e4604fa498edd6ac485deb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF91853/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP46420/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD30072/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ50775> (referer: https://www.auto1.com/v1/car-details-view/CJ50775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063
2026-03-28 09:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063
2026-03-28 09:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063 to the API
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_28e3b079f16fdb4456d10fc0f6080469.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:40:09Z',
 'fuel_type': 'petrol',
 'id': '14331b05-cd5a-51a8-9a6a-0bda0a5c3056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP64063',
 'listing': 'auction',
 'location': 'IT, Agliana (PT)',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 69963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_71754aa83f08bcea30ad2301d96963ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_28e3b079f16fdb4456d10fc0f6080469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_f071deaaade5d6d73bdebd4ec76a64b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_628d44c566e6d0fb1a87bfb1ee071983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_13629832d7ef77881efa104328e6793e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_50246d3b4059c0910576b71148bd4843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_5ee5bf504183b58f48bcc846a543b221.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_3577eba7d5046efc6cd7ac9b9fd193bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_97c0e96318b3246af87387e19c02036c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14331b05-cd5a-51a8-9a6a-0bda0a5c3056/14331b05-cd5a-51a8-9a6a-0bda0a5c3056_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/65/e16524b657dbd96f1968c9922b84d35e/pa/EP64063_2ab751d2a35442a50f2f88f2b884875c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Jazz 1.3 i-VTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP64063%27 HTTP/1.1" 200 None
2026-03-28 09:06:32 [auto1.it] INFO: Saving data for EP64063: {'created_time': 1774688792.402249, 'last_price_update_time': 1774688792.402259, 'auction_closing_time': 1774885209.0}
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP64063') HTTP/1.1" 204 0
2026-03-28 09:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979
2026-03-28 09:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979
2026-03-28 09:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979 to the API
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e8dfb26ffe07b103eff940636a69e7db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.7L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:59Z',
 'fuel_type': 'diesel',
 'id': '944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB28979',
 'listing': 'auction',
 'location': 'IT, Casagiove',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 140125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e23a6c6d951157219d276b5591e412ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3490798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_b408f8973fe2a2584d1de5f673d582d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3193229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a182c9457aa2dc7d65147c5d0cba3930.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e914c4086b4e24f8e9a61e6b1e10c7f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3027523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_fbe2579d686b45657ef37c96ad31f368.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866355,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_137949ade0e4dfc237a6ace07190f215.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2344071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_17c0b87a273e91937bb984964e3820be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_71686608b11ee5b9c2d181a758e2a71a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_e8dfb26ffe07b103eff940636a69e7db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b/944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3133947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/db/7ddbe139d6640446221138ca4767c9c6/pa/CB28979_a39767645dec3b7f45dba4753769b2cc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Sound Edition ISG 2WD',
 'transmission': 'automatic',
 'trim': 'Sound Edition ISG 2WD',
 'year': 2018}
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB28979%27 HTTP/1.1" 200 None
2026-03-28 09:06:32 [auto1.it] INFO: Saving data for CB28979: {'created_time': 1774688792.803726, 'last_price_update_time': 1774688792.803739, 'auction_closing_time': 1774883519.0}
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB28979') HTTP/1.1" 204 0
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_94ec5ed417e2ef95ea950b59d7360194.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_6aa65770d24981d4d87d927a05b12221.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_5b9cf0360dcb83eebd439005d9173d70.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ74443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0bcd10>
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_756186ed86b2dd0b043558bf9397c114.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_756186ed86b2dd0b043558bf9397c114.jpg saved to cache
2026-03-28 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2e6a50>
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_03746f765219b945474a2598c334d8d6.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_03746f765219b945474a2598c334d8d6.jpg saved to cache
2026-03-28 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06798c90>
2026-03-28 09:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_17b3508d9e4604fa498edd6ac485deb1.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_17b3508d9e4604fa498edd6ac485deb1.jpg saved to cache
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775
2026-03-28 09:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with scrape type 1
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_0a1e77242f13a8787d71c104aa2b6f33.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_0a1e77242f13a8787d71c104aa2b6f33.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_aa84e02398f57db8c9404d7973c41162.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_aa84e02398f57db8c9404d7973c41162.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_7d733d41683a05b10401ad9153d07d6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_7d733d41683a05b10401ad9153d07d6e.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_5d46229eb495ca9d954285ca560319ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_5d46229eb495ca9d954285ca560319ad.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_1e13dd52300bae28e7a4438d76b67f0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_1e13dd52300bae28e7a4438d76b67f0f.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_49dee22cc0928d0d4c8dc77a92e7c354.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_49dee22cc0928d0d4c8dc77a92e7c354.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_4883f22bcd008a7adc527b7150c3abef.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_4883f22bcd008a7adc527b7150c3abef.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_9ac084ca5bd028818ba5694fc7de55b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_9ac084ca5bd028818ba5694fc7de55b5.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_126b1fcfc1ed8cac8b3517391c892ca7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_126b1fcfc1ed8cac8b3517391c892ca7.jpg already downloaded
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F52%252F11528e6ba2778245f66341bab7082478%252Fpa%252FCJ50775_6636a5ba7fbc83ec70b7b7c1a45f61b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_6636a5ba7fbc83ec70b7b7c1a45f61b8.jpg already downloaded
2026-03-28 09:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c, identifier: CJ50775
2026-03-28 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_e936516f94247bc610a10f9e783136da.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775
2026-03-28 09:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775
2026-03-28 09:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775 to the API
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CJ50775>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:18:30Z',
 'fuel_type': 'diesel',
 'id': '94cbd0c5-ca26-5f13-9209-e84dda1c8d0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ50775',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 223344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_0a1e77242f13a8787d71c104aa2b6f33.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_aa84e02398f57db8c9404d7973c41162.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_7d733d41683a05b10401ad9153d07d6e.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_5d46229eb495ca9d954285ca560319ad.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_1e13dd52300bae28e7a4438d76b67f0f.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_49dee22cc0928d0d4c8dc77a92e7c354.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_4883f22bcd008a7adc527b7150c3abef.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_9ac084ca5bd028818ba5694fc7de55b5.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_126b1fcfc1ed8cac8b3517391c892ca7.jpg',
                'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_6636a5ba7fbc83ec70b7b7c1a45f61b8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_0a1e77242f13a8787d71c104aa2b6f33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_aa84e02398f57db8c9404d7973c41162.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_7d733d41683a05b10401ad9153d07d6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_5d46229eb495ca9d954285ca560319ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_1e13dd52300bae28e7a4438d76b67f0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_49dee22cc0928d0d4c8dc77a92e7c354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_4883f22bcd008a7adc527b7150c3abef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_9ac084ca5bd028818ba5694fc7de55b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_126b1fcfc1ed8cac8b3517391c892ca7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cbd0c5-ca26-5f13-9209-e84dda1c8d0c/94cbd0c5-ca26-5f13-9209-e84dda1c8d0c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/11528e6ba2778245f66341bab7082478/pa/CJ50775_6636a5ba7fbc83ec70b7b7c1a45f61b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2016}
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ50775%27 HTTP/1.1" 200 None
2026-03-28 09:06:33 [auto1.it] INFO: Saving data for CJ50775: {'created_time': 1774688793.624155, 'last_price_update_time': 1774688793.624169, 'auction_closing_time': 1774883910.0}
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CJ50775') HTTP/1.1" 204 0
2026-03-28 09:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_2e41429075d50ed505fb517969c31374.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_551e99556517249b77c401c307b4b068.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9ba6acf8c35f352b82c3e6c0e9695650.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_847f55b403828df9487fab1bf50a7ba8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK62729/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066b3e10>
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_94ec5ed417e2ef95ea950b59d7360194.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_94ec5ed417e2ef95ea950b59d7360194.jpg saved to cache
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0677d890>
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_6aa65770d24981d4d87d927a05b12221.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_6aa65770d24981d4d87d927a05b12221.jpg saved to cache
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db54c10>
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5a%252F035a0c30703e187ec16f56b92448d5eb%252Fpa%252FYR71782_5b9cf0360dcb83eebd439005d9173d70.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_5b9cf0360dcb83eebd439005d9173d70.jpg saved to cache
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3022335d-6f84-581b-b193-8873e4bbb075
2026-03-28 09:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3022335d-6f84-581b-b193-8873e4bbb075, skipping ID generation
2026-03-28 09:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3022335d-6f84-581b-b193-8873e4bbb075 with scrape type 1
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3022335d-6f84-581b-b193-8873e4bbb075 sending to next pipeline
2026-03-28 09:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3022335d-6f84-581b-b193-8873e4bbb075, identifier: YR71782
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1832d0>
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_c50bb63112347d529c2b567bb748ce3d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg saved to cache
2026-03-28 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782
2026-03-28 09:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782
2026-03-28 09:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782 to the API
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_5b9cf0360dcb83eebd439005d9173d70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:46:42Z',
 'fuel_type': 'petrol',
 'id': '3022335d-6f84-581b-b193-8873e4bbb075',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR71782',
 'listing': 'auction',
 'location': 'IT, Cesano Maderno',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 258470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_5b9cf0360dcb83eebd439005d9173d70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_83e529ccb49edb2ce9e63d09ca25dd7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_c2fe0a7afd1ee0659b48d776918645be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_3bd04a205ec667a4393ae0c463968522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3022335d-6f84-581b-b193-8873e4bbb075/3022335d-6f84-581b-b193-8873e4bbb075_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5a/035a0c30703e187ec16f56b92448d5eb/pa/YR71782_96ccb7da0f3d6257f5334cc79e7ff7a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-28 09:06:34 [auto1.it] INFO: Saving data for YR71782: {'created_time': 1774688794.269569, 'last_price_update_time': 1774688794.269579, 'auction_closing_time': 1774885602.0}
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR71782') HTTP/1.1" 204 0
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0621c650>
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_e936516f94247bc610a10f9e783136da.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_e936516f94247bc610a10f9e783136da.jpg saved to cache
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c57fafe4ff10c8b5d62e53a18ba77a9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_bf621ab836bebf4d96c71d582a740119.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067b8690>
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_2e41429075d50ed505fb517969c31374.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_2e41429075d50ed505fb517969c31374.jpg saved to cache
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06244d50>
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_551e99556517249b77c401c307b4b068.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_551e99556517249b77c401c307b4b068.jpg saved to cache
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c27e590>
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_9ba6acf8c35f352b82c3e6c0e9695650.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9ba6acf8c35f352b82c3e6c0e9695650.jpg saved to cache
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c26ed90>
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_847f55b403828df9487fab1bf50a7ba8.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_847f55b403828df9487fab1bf50a7ba8.jpg saved to cache
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_1774adbd279fe8214056e15a697a8e98.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06714950>
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb4%252F91b4aaa4a3fc3557fe442b818a528573%252Fpa%252FMN63848_766e9c695aa178c31e69322cb6b3b6db.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg saved to cache
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-03-28 09:06:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c, skipping ID generation
2026-03-28 09:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with scrape type 1
2026-03-28 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c sending to next pipeline
2026-03-28 09:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c, identifier: MN63848
2026-03-28 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_f4832ae067bd6155d408d5836f4e2b41.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-03-28 09:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-03-28 09:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848 to the API
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:50:06Z',
 'fuel_type': 'diesel',
 'id': '446c9d9f-984f-51fb-ad7a-b3fac5eea97c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN63848',
 'listing': 'auction',
 'location': 'IT, Forlì',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 196695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2017}
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN63848%27 HTTP/1.1" 200 None
2026-03-28 09:06:34 [auto1.it] INFO: Saving data for MN63848: {'created_time': 1774688794.979505, 'last_price_update_time': 1774688794.979515, 'auction_closing_time': 1774885806.0}
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN63848') HTTP/1.1" 204 0
2026-03-28 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_8a07fa7f46982ed27c52fc7068402fa2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06243010>
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fd1%252Fc4d1e9cf6297dda73e2a13e1a942730d%252Fpa%252FJE70672_c57fafe4ff10c8b5d62e53a18ba77a9d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c57fafe4ff10c8b5d62e53a18ba77a9d.jpg saved to cache
2026-03-28 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0201274d-d103-5b9f-b47f-a2350e121c7b
2026-03-28 09:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0201274d-d103-5b9f-b47f-a2350e121c7b, skipping ID generation
2026-03-28 09:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0201274d-d103-5b9f-b47f-a2350e121c7b with scrape type 1
2026-03-28 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0201274d-d103-5b9f-b47f-a2350e121c7b sending to next pipeline
2026-03-28 09:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0201274d-d103-5b9f-b47f-a2350e121c7b, identifier: JE70672
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06247a90>
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2b%252Fab2b3c9bf7a60b0c32da18d78e1a66de%252Fpa%252FYC40082_bf621ab836bebf4d96c71d582a740119.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_bf621ab836bebf4d96c71d582a740119.jpg saved to cache
2026-03-28 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4557617-4b44-5adc-99d6-a74dd5a5ce51
2026-03-28 09:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4557617-4b44-5adc-99d6-a74dd5a5ce51, skipping ID generation
2026-03-28 09:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4557617-4b44-5adc-99d6-a74dd5a5ce51 with scrape type 1
2026-03-28 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4557617-4b44-5adc-99d6-a74dd5a5ce51 sending to next pipeline
2026-03-28 09:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4557617-4b44-5adc-99d6-a74dd5a5ce51, identifier: YC40082
2026-03-28 09:06:35 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ae4d7e73da3447a8ef21640c16ee6df3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672
2026-03-28 09:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672
2026-03-28 09:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672 to the API
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c57fafe4ff10c8b5d62e53a18ba77a9d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:12:48Z',
 'fuel_type': 'diesel',
 'id': '0201274d-d103-5b9f-b47f-a2350e121c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE70672',
 'listing': 'auction',
 'location': 'IT, Rovato',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_b91159808c65dd106e40987697a9fbce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9e49e07815a24d31c17b22a3b0eaa63e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c4fe16da11123bc43892ece020dc00e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_59823ca9e9fb7db12a3ceb3579e22d40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_c57fafe4ff10c8b5d62e53a18ba77a9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_f30e6c3312eaa0558f4b40650df0290c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_e936516f94247bc610a10f9e783136da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_9ba6acf8c35f352b82c3e6c0e9695650.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_94ec5ed417e2ef95ea950b59d7360194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0201274d-d103-5b9f-b47f-a2350e121c7b/0201274d-d103-5b9f-b47f-a2350e121c7b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/d1/c4d1e9cf6297dda73e2a13e1a942730d/pa/JE70672_756186ed86b2dd0b043558bf9397c114.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Executive BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion Tech',
 'year': 2016}
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE70672%27 HTTP/1.1" 200 None
2026-03-28 09:06:35 [auto1.it] INFO: Saving data for JE70672: {'created_time': 1774688795.659509, 'last_price_update_time': 1774688795.659518, 'auction_closing_time': 1774883568.0}
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE70672') HTTP/1.1" 204 0
2026-03-28 09:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082
2026-03-28 09:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082
2026-03-28 09:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082 to the API
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_bf621ab836bebf4d96c71d582a740119.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:40Z',
 'fuel_type': 'diesel',
 'id': 'd4557617-4b44-5adc-99d6-a74dd5a5ce51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC40082',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 97627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_bf621ab836bebf4d96c71d582a740119.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_0dbcb81dddce1fa10839bef5d7f8dbd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_49584029ebfc5cdaa9cd4173eeaa868e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_2e41429075d50ed505fb517969c31374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_17b3508d9e4604fa498edd6ac485deb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_eca4f3d3af907471deb3b7e3baf3661c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_ab676d57f8feee3e8df8fbbfc0039a87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_d6ed9ba7644caeb7410584437fbffe86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_be25f0d74bdff2541669cd5ca6b4bda2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4557617-4b44-5adc-99d6-a74dd5a5ce51/d4557617-4b44-5adc-99d6-a74dd5a5ce51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2b/ab2b3c9bf7a60b0c32da18d78e1a66de/pa/YC40082_8664de2304747b5ec2dcbb8f73fb8321.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC40082%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Saving data for YC40082: {'created_time': 1774688796.031427, 'last_price_update_time': 1774688796.031436, 'auction_closing_time': 1774883380.0}
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YC40082') HTTP/1.1" 204 0
2026-03-28 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_e079166d0911fb5f3044d46bfb62d281.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN52705%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for UN52705: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG71843%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for HG71843: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: CE81369
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE81369%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for CE81369: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: XJ87155
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: CE17965
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: PJ77887
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: YF31693
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF31693%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for YF31693: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: ZR65304
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR65304%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for ZR65304: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC79515%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for XC79515: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22107%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for SH22107: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: WD83298
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH35372%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for XH35372: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK72900%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for GK72900: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT99583%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for YT99583: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP72281%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for JP72281: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: AS43039
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH72386%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for MH72386: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: KX04923
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: XW72958
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW72958%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for XW72958: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: HH27298
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH27298%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for HH27298: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: JP60910
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: MS15959
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: UB22158
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: VT21354
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: JZ95441
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ95441%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for JZ95441: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: HV53293
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: DR60838
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR60838%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for DR60838: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: BF36974
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: LG94393
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG94393%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for LG94393: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: HP74394
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP74394%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for HP74394: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME64112%27 HTTP/1.1" 200 None
2026-03-28 09:06:36 [auto1.it] INFO: Scrape type for ME64112: 0
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: TP47880
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: YJ46375
2026-03-28 09:06:36 [auto1.it] INFO: Found listing with ID: PF40120
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06245610>
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F03%252F8803cae158fcff137f918c31893fba6a%252Fpa%252FNK26905_1774adbd279fe8214056e15a697a8e98.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_1774adbd279fe8214056e15a697a8e98.jpg saved to cache
2026-03-28 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7
2026-03-28 09:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7, skipping ID generation
2026-03-28 09:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with scrape type 1
2026-03-28 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 sending to next pipeline
2026-03-28 09:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7, identifier: NK26905
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0651c390>
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_f4832ae067bd6155d408d5836f4e2b41.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_f4832ae067bd6155d408d5836f4e2b41.jpg saved to cache
2026-03-28 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_daf027ff8a78ea8dfce33af9ae733db4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_a5d630862145b54aa78563bd349493d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_16e092c1518d78081221b13b6d9526a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF91853> (referer: https://www.auto1.com/v1/car-details-view/DF91853/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905
2026-03-28 09:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905
2026-03-28 09:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905 to the API
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_1774adbd279fe8214056e15a697a8e98.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:18:18Z',
 'fuel_type': 'petrol',
 'id': '6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK26905',
 'listing': 'auction',
 'location': 'IT, Lecco',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 119046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_fe66eb89a7b9ba7db8d18a39f753de55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_3824e0245a7ddc29d79c0e5fd5f1bef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_5d9cf4913dc1a478dc625d9e4dcccd30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_a10817d8b7a18f26291cc6c7dab55746.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_1774adbd279fe8214056e15a697a8e98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_f5d91326bdf3782efc93c452b6d6bf44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_551e99556517249b77c401c307b4b068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_847f55b403828df9487fab1bf50a7ba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_6aa65770d24981d4d87d927a05b12221.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7/6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/03/8803cae158fcff137f918c31893fba6a/pa/NK26905_03746f765219b945474a2598c334d8d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2018}
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK26905%27 HTTP/1.1" 200 None
2026-03-28 09:06:37 [auto1.it] INFO: Saving data for NK26905: {'created_time': 1774688797.046401, 'last_price_update_time': 1774688797.046416, 'auction_closing_time': 1774883898.0}
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK26905') HTTP/1.1" 204 0
2026-03-28 09:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD21393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD30072> (referer: https://www.auto1.com/v1/car-details-view/PD30072/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP46420> (referer: https://www.auto1.com/v1/car-details-view/GP46420/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH04778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065d0bd0>
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_8a07fa7f46982ed27c52fc7068402fa2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_8a07fa7f46982ed27c52fc7068402fa2.jpg saved to cache
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065fb210>
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0d%252Fff0dc82d4268c50f583f4a6e82ec2b51%252Fpa%252FUE94474_ae4d7e73da3447a8ef21640c16ee6df3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ae4d7e73da3447a8ef21640c16ee6df3.jpg saved to cache
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 348d1838-f3b3-5602-b58c-d387a09af876
2026-03-28 09:06:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 348d1838-f3b3-5602-b58c-d387a09af876, skipping ID generation
2026-03-28 09:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348d1838-f3b3-5602-b58c-d387a09af876 with scrape type 1
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 348d1838-f3b3-5602-b58c-d387a09af876 sending to next pipeline
2026-03-28 09:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 348d1838-f3b3-5602-b58c-d387a09af876, identifier: UE94474
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065bac90>
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_e079166d0911fb5f3044d46bfb62d281.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_e079166d0911fb5f3044d46bfb62d281.jpg saved to cache
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73
2026-03-28 09:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474
2026-03-28 09:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474
2026-03-28 09:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474 to the API
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ae4d7e73da3447a8ef21640c16ee6df3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:11:05Z',
 'fuel_type': 'diesel',
 'id': '348d1838-f3b3-5602-b58c-d387a09af876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE94474',
 'listing': 'auction',
 'location': 'IT, Cesano Maderno',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 195077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ff5d140af868b505be40f22002a63350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0fd89412cf8570dcb698c80a19937edb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ae4d7e73da3447a8ef21640c16ee6df3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_f4832ae067bd6155d408d5836f4e2b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_bdf7a84cb5e933a0d4201b1e76ac99d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_0a8e205748dfd58d44cfc47715a8d6d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_727df96f7bf31ddbc83da1ade48be85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_045379d06b845b3d431e98fca80ef960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_ceee493f3c96df2f90d3bb148bd56fee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348d1838-f3b3-5602-b58c-d387a09af876/348d1838-f3b3-5602-b58c-d387a09af876_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/0d/ff0dc82d4268c50f583f4a6e82ec2b51/pa/UE94474_c29821132c73bbe2be65611716d37fa4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE94474%27 HTTP/1.1" 200 None
2026-03-28 09:06:37 [auto1.it] INFO: Saving data for UE94474: {'created_time': 1774688797.736942, 'last_price_update_time': 1774688797.736952, 'auction_closing_time': 1774883465.0}
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UE94474') HTTP/1.1" 204 0
2026-03-28 09:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061d6f50>
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_daf027ff8a78ea8dfce33af9ae733db4.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_daf027ff8a78ea8dfce33af9ae733db4.jpg saved to cache
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db57dd0>
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_a5d630862145b54aa78563bd349493d2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_a5d630862145b54aa78563bd349493d2.jpg saved to cache
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06517590>
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ffd%252F97fd4286cb0a7a2e2ad14be0cd222ea8%252Fpa%252FSP24974_16e092c1518d78081221b13b6d9526a4.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_16e092c1518d78081221b13b6d9526a4.jpg saved to cache
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73
2026-03-28 09:06:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73, skipping ID generation
2026-03-28 09:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with scrape type 1
2026-03-28 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 sending to next pipeline
2026-03-28 09:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73, identifier: SP24974
2026-03-28 09:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853
2026-03-28 09:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with scrape type 1
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_1666c7311b4150c4c94879bf33de858e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_1666c7311b4150c4c94879bf33de858e.jpg not downloaded yet
2026-03-28 09:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974
2026-03-28 09:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974
2026-03-28 09:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974 to the API
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_16e092c1518d78081221b13b6d9526a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:11:07Z',
 'fuel_type': 'petrol',
 'id': '93f50bf2-fac4-5ee7-8ae1-78949ff3ee73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP24974',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 135445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_a5d630862145b54aa78563bd349493d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_16e092c1518d78081221b13b6d9526a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_e079166d0911fb5f3044d46bfb62d281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_8a07fa7f46982ed27c52fc7068402fa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93f50bf2-fac4-5ee7-8ae1-78949ff3ee73/93f50bf2-fac4-5ee7-8ae1-78949ff3ee73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/fd/97fd4286cb0a7a2e2ad14be0cd222ea8/pa/SP24974_0ebe23f8d4f05ef75ebc050ebebaa55c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP24974%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [auto1.it] INFO: Saving data for SP24974: {'created_time': 1774688798.42674, 'last_price_update_time': 1774688798.42675, 'auction_closing_time': 1774883467.0}
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP24974') HTTP/1.1" 204 0
2026-03-28 09:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072
2026-03-28 09:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867f7bec-ab0d-5cac-9780-7aeddac0960f with scrape type 1
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 867f7bec-ab0d-5cac-9780-7aeddac0960f
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_d4027fc9e4247c9e3a7e0552bc4d3852.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_d4027fc9e4247c9e3a7e0552bc4d3852.jpg not downloaded yet
2026-03-28 09:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420
2026-03-28 09:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e9f24f-19d7-5232-a322-19d30db54d3d with scrape type 1
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_d4c6dc2d313d45b958bfedc02cd57015.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4c6dc2d313d45b958bfedc02cd57015.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_85461e1fa87fd993f467c2d82c5367db.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_85461e1fa87fd993f467c2d82c5367db.jpg not downloaded yet
2026-03-28 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR16346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW00940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_a2cd8cc7860451cd9b524253ab935e43.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_275cbae48e0d059e2a362d2864557100.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_275cbae48e0d059e2a362d2864557100.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_398dc99f5370fc93e396236ee8cc07aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_398dc99f5370fc93e396236ee8cc07aa.jpg not downloaded yet
2026-03-28 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ74443> (referer: https://www.auto1.com/v1/car-details-view/PZ74443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_e951b159ceb85c7bba015c5bdc2424e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_e951b159ceb85c7bba015c5bdc2424e3.jpg not downloaded yet
2026-03-28 09:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_f8ee48513e81b08a3a537dc55d9ad101.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f8ee48513e81b08a3a537dc55d9ad101.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_3344000c4d84f37803a762d7a742cbea.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_3344000c4d84f37803a762d7a742cbea.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_7f498683fd01483e8b15edd0eadd6380.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_7f498683fd01483e8b15edd0eadd6380.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_9a7acef5141d687237d24c551ffb71cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_9a7acef5141d687237d24c551ffb71cd.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_b5e05a0b13c6992b872954170356d3de.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_b5e05a0b13c6992b872954170356d3de.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_a8b9fdebfe3827619d27c88c4563bc8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_a8b9fdebfe3827619d27c88c4563bc8f.jpg not downloaded yet
2026-03-28 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_d4027fc9e4247c9e3a7e0552bc4d3852.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_6fea7b68af4628dddd8789f58507818e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_6fea7b68af4628dddd8789f58507818e.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_d4ce6cd3421e9e94ca21d81000d012d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4ce6cd3421e9e94ca21d81000d012d0.jpg not downloaded yet
2026-03-28 09:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065bef50>
2026-03-28 09:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F6d%252F9a6dbf72de1c498a3aced0dd96f66272%252Fpa%252FLG70821_a2cd8cc7860451cd9b524253ab935e43.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_a2cd8cc7860451cd9b524253ab935e43.jpg saved to cache
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758
2026-03-28 09:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758, skipping ID generation
2026-03-28 09:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with scrape type 1
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 sending to next pipeline
2026-03-28 09:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758, identifier: LG70821
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_f27e8dc6c579ebbf8b975f915f3af6fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f27e8dc6c579ebbf8b975f915f3af6fe.jpg not downloaded yet
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_1ce07c98344ee1279209433e7ef3c358.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_1ce07c98344ee1279209433e7ef3c358.jpg not downloaded yet
2026-03-28 09:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821
2026-03-28 09:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821
2026-03-28 09:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821 to the API
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_a2cd8cc7860451cd9b524253ab935e43.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:08Z',
 'fuel_type': 'diesel',
 'id': '1b1fa12d-e7ae-5664-8ceb-85f120eb9758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG70821',
 'listing': 'auction',
 'location': 'IT, Parma',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 127639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_235d495e96784574477bbca9f830ee22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_f011bac8535244356787afbe67bd3153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_aec5c383a994faacdafee3ca74f7b615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_74b77543f08005abd2e751c00502abe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_ceaa546d814338e59019b83acf121d4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_daf027ff8a78ea8dfce33af9ae733db4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_45acfae2e5f9fb0e052763b13977ed1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_68f2d9a291ce0faf127a59a1660c0f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_8a16753c27a338b867ffcace67e4580d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1fa12d-e7ae-5664-8ceb-85f120eb9758/1b1fa12d-e7ae-5664-8ceb-85f120eb9758_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2529387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/6d/9a6dbf72de1c498a3aced0dd96f66272/pa/LG70821_a2cd8cc7860451cd9b524253ab935e43.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Brave² 4x2',
 'transmission': 'manual',
 'trim': 'Brave² 4x2',
 'year': 2018}
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG70821%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [auto1.it] INFO: Saving data for LG70821: {'created_time': 1774688799.328714, 'last_price_update_time': 1774688799.328724, 'auction_closing_time': 1774885568.0}
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG70821') HTTP/1.1" 204 0
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4c6dc2d313d45b958bfedc02cd57015.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_85461e1fa87fd993f467c2d82c5367db.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_f5f119c3319d48e506950b3fc9006021.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_f5f119c3319d48e506950b3fc9006021.jpg not downloaded yet
2026-03-28 09:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443
2026-03-28 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcbeaf6-ccb5-5903-89be-190be0822dba with scrape type 1
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_715feb5843879af2d2c1d23d8e39997a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_715feb5843879af2d2c1d23d8e39997a.jpg not downloaded yet
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2b4c90>
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_d4027fc9e4247c9e3a7e0552bc4d3852.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_d4027fc9e4247c9e3a7e0552bc4d3852.jpg saved to cache
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 867f7bec-ab0d-5cac-9780-7aeddac0960f
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_cca31cc193d74d667600842c8deb9fb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_cca31cc193d74d667600842c8deb9fb2.jpg not downloaded yet
2026-03-28 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_e062b4e15befbfdb82068d9ccb967b76.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_e062b4e15befbfdb82068d9ccb967b76.jpg not downloaded yet
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU48756> (referer: https://www.auto1.com/v1/car-details-view/WU48756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR61031> (referer: https://www.auto1.com/v1/car-details-view/HR61031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_7e5c319dce39ab3b9fa1cbe608219707.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_7e5c319dce39ab3b9fa1cbe608219707.jpg not downloaded yet
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_76dfd52ab8a0f764bdf00477c0c408f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_76dfd52ab8a0f764bdf00477c0c408f0.jpg not downloaded yet
2026-03-28 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK62729> (referer: https://www.auto1.com/v1/car-details-view/XK62729/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06216cd0>
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_d4c6dc2d313d45b958bfedc02cd57015.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4c6dc2d313d45b958bfedc02cd57015.jpg saved to cache
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2b4110>
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_85461e1fa87fd993f467c2d82c5367db.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_85461e1fa87fd993f467c2d82c5367db.jpg saved to cache
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_ed726c0a049255c60444023bd6fdd7e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_ed726c0a049255c60444023bd6fdd7e7.jpg not downloaded yet
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_cc1c665e77be0a29586ba0940868bfa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_cc1c665e77be0a29586ba0940868bfa1.jpg not downloaded yet
2026-03-28 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f27e8dc6c579ebbf8b975f915f3af6fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_a8b9fdebfe3827619d27c88c4563bc8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_715feb5843879af2d2c1d23d8e39997a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_7415fe4764ef336cf0f49da5a45d8553.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_7415fe4764ef336cf0f49da5a45d8553.jpg not downloaded yet
2026-03-28 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP67579/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:39 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756
2026-03-28 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with scrape type 1
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27df52f4-daf0-5a30-bf3d-faa9dec0fa40
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_dd845400749ad598161230dca6b85b20.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_dd845400749ad598161230dca6b85b20.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_cbc937fc8a9ddb649dfed357f6867c1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_cbc937fc8a9ddb649dfed357f6867c1a.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_fc180518ec07d0f86a1b63a6a24616b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_fc180518ec07d0f86a1b63a6a24616b3.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_2f4b128a16a3cb5ec1eeea8a724e8c92.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_2f4b128a16a3cb5ec1eeea8a724e8c92.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_dd7ca11b5b0f0bc4d3c40fe64c3b1c32.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_dd7ca11b5b0f0bc4d3c40fe64c3b1c32.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_4e845f5ebcf250df97698ae7a5d6385f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_4e845f5ebcf250df97698ae7a5d6385f.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_df5530eee5bd7d7f90978297309774fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_df5530eee5bd7d7f90978297309774fc.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_1ebf9d8b9368a671d115ce56fd4d5f23.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_1ebf9d8b9368a671d115ce56fd4d5f23.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_2f24dc0dac8f194567521bc871f1002b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_2f24dc0dac8f194567521bc871f1002b.jpg already downloaded
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F3f%252Fa13f0b0efca7c88ee0e9f7b9b7998d97%252Fpa%252FWU48756_d80175577112f8cb26fbf3771a291cce.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_d80175577112f8cb26fbf3771a291cce.jpg already downloaded
2026-03-28 09:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40, identifier: WU48756
2026-03-28 09:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031
2026-03-28 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06fc907a-d0b0-59af-818a-07274779fdab with scrape type 1
2026-03-28 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_43beed1da32d8733b1147a3891ef7716.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_43beed1da32d8733b1147a3891ef7716.jpg not downloaded yet
2026-03-28 09:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756
2026-03-28 09:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756
2026-03-28 09:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756 to the API
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU48756>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:37:17Z',
 'fuel_type': 'diesel',
 'id': '27df52f4-daf0-5a30-bf3d-faa9dec0fa40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU48756',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 165240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_dd845400749ad598161230dca6b85b20.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_cbc937fc8a9ddb649dfed357f6867c1a.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_fc180518ec07d0f86a1b63a6a24616b3.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_2f4b128a16a3cb5ec1eeea8a724e8c92.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_dd7ca11b5b0f0bc4d3c40fe64c3b1c32.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_4e845f5ebcf250df97698ae7a5d6385f.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_df5530eee5bd7d7f90978297309774fc.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_1ebf9d8b9368a671d115ce56fd4d5f23.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_2f24dc0dac8f194567521bc871f1002b.jpg',
                'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_d80175577112f8cb26fbf3771a291cce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_dd845400749ad598161230dca6b85b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_cbc937fc8a9ddb649dfed357f6867c1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_fc180518ec07d0f86a1b63a6a24616b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_2f4b128a16a3cb5ec1eeea8a724e8c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_dd7ca11b5b0f0bc4d3c40fe64c3b1c32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_4e845f5ebcf250df97698ae7a5d6385f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_df5530eee5bd7d7f90978297309774fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_1ebf9d8b9368a671d115ce56fd4d5f23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_2f24dc0dac8f194567521bc871f1002b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27df52f4-daf0-5a30-bf3d-faa9dec0fa40/27df52f4-daf0-5a30-bf3d-faa9dec0fa40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/3f/a13f0b0efca7c88ee0e9f7b9b7998d97/pa/WU48756_d80175577112f8cb26fbf3771a291cce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2020}
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48756%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Saving data for WU48756: {'created_time': 1774688800.333907, 'last_price_update_time': 1774688800.333916, 'auction_closing_time': 1774885037.0}
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU48756') HTTP/1.1" 204 0
2026-03-28 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_76dfd52ab8a0f764bdf00477c0c408f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_68cc43833a23f94c43aa9495e13c0cb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_68cc43833a23f94c43aa9495e13c0cb3.jpg not downloaded yet
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: HX55945
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX55945%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for HX55945: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: HT98795
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: PH46734
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH46734%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for PH46734: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: EE49908
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: VC73391
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: SP57651
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: TP78592
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP78592%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for TP78592: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ45475%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for AJ45475: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: EN15125
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN15125%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for EN15125: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: GU66352
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU66352%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for GU66352: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: KN87461
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN87461%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for KN87461: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: DY04825
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: XR49803
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR49803%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for XR49803: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: WM63577
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM63577%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for WM63577: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: GV52121
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV52121%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for GV52121: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: JP45376
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP45376%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for JP45376: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: US40525
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ86480%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for MJ86480: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: ZJ84308
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ84308%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for ZJ84308: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: FE03475
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: MW97099
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU82988%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for EU82988: 0
2026-03-28 09:06:40 [auto1.it] INFO: Found listing with ID: BE00286
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00286%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [auto1.it] INFO: Scrape type for BE00286: 2
2026-03-28 09:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286
2026-03-28 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with scrape type 2
2026-03-28 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with scrape type 2
2026-03-28 09:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39, identifier: BE00286
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_684721a36021309b2da9c1d97332254e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_684721a36021309b2da9c1d97332254e.jpg not downloaded yet
2026-03-28 09:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729
2026-03-28 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbc101d-1cce-5619-9943-d813bcfb86bc with scrape type 1
2026-03-28 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_2d6b3db1790d0ae62513dd5d05880b31.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_2d6b3db1790d0ae62513dd5d05880b31.jpg not downloaded yet
2026-03-28 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_f5f119c3319d48e506950b3fc9006021.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_1ce07c98344ee1279209433e7ef3c358.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_e062b4e15befbfdb82068d9ccb967b76.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_cca31cc193d74d667600842c8deb9fb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286
2026-03-28 09:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286
2026-03-28 09:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286 to the API
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:37:02Z',
 'fuel_type': 'diesel',
 'id': '835657e5-8afa-5d9b-9d2b-34a38ba9ef39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE00286',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 207944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2015}
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00286%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Saving data for BE00286: {'auction_closing_time': 1774715822.0, 'created_time': 1774473015.423487, 'last_price_update_time': 1774688801.06622}
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE00286') HTTP/1.1" 204 0
2026-03-28 09:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM70792/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR04246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_7e5c319dce39ab3b9fa1cbe608219707.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_1a78d1a793fa5c3e1e74748dcbb2a81a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_1a78d1a793fa5c3e1e74748dcbb2a81a.jpg not downloaded yet
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: MC12015
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC12015%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for MC12015: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: AW62695
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW62695%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for AW62695: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: SK48941
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: CM36340
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM36340%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for CM36340: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: CZ82762
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ82762%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for CZ82762: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: SB02789
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB02789%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for SB02789: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: YN65512
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: WR41361
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR41361%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for WR41361: 2
2026-03-28 09:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361
2026-03-28 09:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with scrape type 2
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with scrape type 2
2026-03-28 09:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aedcd70f-872d-5b95-9bcd-5e15d1563ed9, identifier: WR41361
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_a018f5dfdf6131637b1809cd6884f6c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_a018f5dfdf6131637b1809cd6884f6c8.jpg not downloaded yet
2026-03-28 09:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_46b3f2a49d8e3c73e58a61b3cc1bfd77.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_46b3f2a49d8e3c73e58a61b3cc1bfd77.jpg not downloaded yet
2026-03-28 09:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK68121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065fb110>
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_f27e8dc6c579ebbf8b975f915f3af6fe.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f27e8dc6c579ebbf8b975f915f3af6fe.jpg saved to cache
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 867f7bec-ab0d-5cac-9780-7aeddac0960f
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0622cb90>
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_a8b9fdebfe3827619d27c88c4563bc8f.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_a8b9fdebfe3827619d27c88c4563bc8f.jpg saved to cache
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065921d0>
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_715feb5843879af2d2c1d23d8e39997a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_715feb5843879af2d2c1d23d8e39997a.jpg saved to cache
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361
2026-03-28 09:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361
2026-03-28 09:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361 to the API
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:01:24Z',
 'fuel_type': 'petrol',
 'id': 'aedcd70f-872d-5b95-9bcd-5e15d1563ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR41361',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 174078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2014}
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR41361%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Saving data for WR41361: {'auction_closing_time': 1774713684.0, 'created_time': 1774473119.052966, 'last_price_update_time': 1774688801.857867}
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR41361') HTTP/1.1" 204 0
2026-03-28 09:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c10bd90>
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_76dfd52ab8a0f764bdf00477c0c408f0.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_76dfd52ab8a0f764bdf00477c0c408f0.jpg saved to cache
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_43beed1da32d8733b1147a3891ef7716.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_d368aa0c33057f1f9a27635e284b04de.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_d368aa0c33057f1f9a27635e284b04de.jpg not downloaded yet
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: SE28120
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE28120%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for SE28120: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: MG07654
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: TP85930
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP85930%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for TP85930: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: MM75159
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM75159%27 HTTP/1.1" 200 None
2026-03-28 09:06:41 [auto1.it] INFO: Scrape type for MM75159: 0
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-28 09:06:41 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-28 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG60202%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [auto1.it] INFO: Scrape type for TG60202: 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_b3e9e8fa2b2091b9e58b99be06de2c74.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_b3e9e8fa2b2091b9e58b99be06de2c74.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_7a32415f99c0f494efc10407e160ce56.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7a32415f99c0f494efc10407e160ce56.jpg not downloaded yet
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0676da50>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_f5f119c3319d48e506950b3fc9006021.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_f5f119c3319d48e506950b3fc9006021.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06733690>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_1ce07c98344ee1279209433e7ef3c358.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_1ce07c98344ee1279209433e7ef3c358.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2e7150>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_e062b4e15befbfdb82068d9ccb967b76.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_e062b4e15befbfdb82068d9ccb967b76.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066a5850>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_cca31cc193d74d667600842c8deb9fb2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_cca31cc193d74d667600842c8deb9fb2.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_7415fe4764ef336cf0f49da5a45d8553.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_cc1c665e77be0a29586ba0940868bfa1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c7584d0>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_7e5c319dce39ab3b9fa1cbe608219707.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_7e5c319dce39ab3b9fa1cbe608219707.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_68cc43833a23f94c43aa9495e13c0cb3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_ed726c0a049255c60444023bd6fdd7e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_fe95a463d68e8de90e0c320ae14433c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_fe95a463d68e8de90e0c320ae14433c0.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_cd2b7ef1a31b192c8b2f2c8aab97eeee.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_cd2b7ef1a31b192c8b2f2c8aab97eeee.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_a7e41c179458d9f743ca0b92bbbf9439.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_a7e41c179458d9f743ca0b92bbbf9439.jpg not downloaded yet
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC92896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW35507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_2d6b3db1790d0ae62513dd5d05880b31.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG64342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c028790>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_43beed1da32d8733b1147a3891ef7716.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_43beed1da32d8733b1147a3891ef7716.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_9ffbae4c53d038c9234a0aea4292850e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_9ffbae4c53d038c9234a0aea4292850e.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_e16f86602d65b66738fdb4afc48683d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_e16f86602d65b66738fdb4afc48683d6.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_aef504e21c2fe1efd69b782db5692bec.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_aef504e21c2fe1efd69b782db5692bec.jpg not downloaded yet
2026-03-28 09:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0cc510>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_7415fe4764ef336cf0f49da5a45d8553.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_7415fe4764ef336cf0f49da5a45d8553.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0dd2dfd0>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_cc1c665e77be0a29586ba0940868bfa1.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_cc1c665e77be0a29586ba0940868bfa1.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_074537236bb5f5a5d15c7dde926417b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_074537236bb5f5a5d15c7dde926417b2.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_5a395648350da07d564a4631393111de.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_5a395648350da07d564a4631393111de.jpg not downloaded yet
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1c24d0>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_68cc43833a23f94c43aa9495e13c0cb3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_68cc43833a23f94c43aa9495e13c0cb3.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0663f210>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_ed726c0a049255c60444023bd6fdd7e7.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_ed726c0a049255c60444023bd6fdd7e7.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_a018f5dfdf6131637b1809cd6884f6c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7a32415f99c0f494efc10407e160ce56.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_b3e9e8fa2b2091b9e58b99be06de2c74.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4ce6cd3421e9e94ca21d81000d012d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_46b3f2a49d8e3c73e58a61b3cc1bfd77.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_f981811bac556370183eebfadf80cdc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_f981811bac556370183eebfadf80cdc3.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_cf38357147d0c5f033bc06c07852dfbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_cf38357147d0c5f033bc06c07852dfbf.jpg not downloaded yet
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06596ed0>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_2d6b3db1790d0ae62513dd5d05880b31.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_2d6b3db1790d0ae62513dd5d05880b31.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_a7e41c179458d9f743ca0b92bbbf9439.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_4463f5dc18e52d5b5f932b26ff8f76a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_4463f5dc18e52d5b5f932b26ff8f76a6.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_7366473108e7fee42d06501d75a3cee8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7366473108e7fee42d06501d75a3cee8.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_5a61251cbcb1ff11eeeeda8d35974c22.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_5a61251cbcb1ff11eeeeda8d35974c22.jpg not downloaded yet
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_53ef978a65acb1ea1d822301358b2767.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_53ef978a65acb1ea1d822301358b2767.jpg not downloaded yet
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_5a395648350da07d564a4631393111de.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB22824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2dfa50>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_a018f5dfdf6131637b1809cd6884f6c8.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_a018f5dfdf6131637b1809cd6884f6c8.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c156750>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_7a32415f99c0f494efc10407e160ce56.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7a32415f99c0f494efc10407e160ce56.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0e5290>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_b3e9e8fa2b2091b9e58b99be06de2c74.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_b3e9e8fa2b2091b9e58b99be06de2c74.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0bc910>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_d4ce6cd3421e9e94ca21d81000d012d0.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4ce6cd3421e9e94ca21d81000d012d0.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067097d0>
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_46b3f2a49d8e3c73e58a61b3cc1bfd77.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_46b3f2a49d8e3c73e58a61b3cc1bfd77.jpg saved to cache
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_55d4e7976ef1a2c0f9eed5764e08092d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_55d4e7976ef1a2c0f9eed5764e08092d.jpg not downloaded yet
2026-03-28 09:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_aef504e21c2fe1efd69b782db5692bec.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_e16f86602d65b66738fdb4afc48683d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_9ffbae4c53d038c9234a0aea4292850e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_074537236bb5f5a5d15c7dde926417b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH04778> (referer: https://www.auto1.com/v1/car-details-view/MH04778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06793f90>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_a7e41c179458d9f743ca0b92bbbf9439.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_a7e41c179458d9f743ca0b92bbbf9439.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0663fd90>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_5a395648350da07d564a4631393111de.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_5a395648350da07d564a4631393111de.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_684721a36021309b2da9c1d97332254e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c26f310>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_aef504e21c2fe1efd69b782db5692bec.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_aef504e21c2fe1efd69b782db5692bec.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c07a4d0>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_e16f86602d65b66738fdb4afc48683d6.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_e16f86602d65b66738fdb4afc48683d6.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c26d150>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_9ffbae4c53d038c9234a0aea4292850e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_9ffbae4c53d038c9234a0aea4292850e.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0a6f90>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_074537236bb5f5a5d15c7dde926417b2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_074537236bb5f5a5d15c7dde926417b2.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778
2026-03-28 09:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106f47da-14b9-5c47-a547-cea8110544c4 with scrape type 1
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 106f47da-14b9-5c47-a547-cea8110544c4
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_4d7631bbeb5eac3f7277aa3e4e3047f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_4d7631bbeb5eac3f7277aa3e4e3047f8.jpg not downloaded yet
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_55d4e7976ef1a2c0f9eed5764e08092d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_18a8a743aabe178f2be8cbbd242c0a3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_18a8a743aabe178f2be8cbbd242c0a3a.jpg not downloaded yet
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7366473108e7fee42d06501d75a3cee8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_53ef978a65acb1ea1d822301358b2767.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0663f7d0>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_684721a36021309b2da9c1d97332254e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_684721a36021309b2da9c1d97332254e.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_4463f5dc18e52d5b5f932b26ff8f76a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_99fc2bf110eecfd32ec8e4184e4f246d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_99fc2bf110eecfd32ec8e4184e4f246d.jpg not downloaded yet
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_a457d0568fd37277ef3e9a73b88d2af7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_a457d0568fd37277ef3e9a73b88d2af7.jpg not downloaded yet
2026-03-28 09:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW00940> (referer: https://www.auto1.com/v1/car-details-view/UW00940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1e0e10>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_55d4e7976ef1a2c0f9eed5764e08092d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_55d4e7976ef1a2c0f9eed5764e08092d.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c282290>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_7366473108e7fee42d06501d75a3cee8.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7366473108e7fee42d06501d75a3cee8.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c271350>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_53ef978a65acb1ea1d822301358b2767.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_53ef978a65acb1ea1d822301358b2767.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR16346> (referer: https://www.auto1.com/v1/car-details-view/CR16346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_f89e4d0b095b4724102d36ac1c51ff20.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_f89e4d0b095b4724102d36ac1c51ff20.jpg not downloaded yet
2026-03-28 09:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_4d7631bbeb5eac3f7277aa3e4e3047f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP67579> (referer: https://www.auto1.com/v1/car-details-view/VP67579/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK68121> (referer: https://www.auto1.com/v1/car-details-view/WK68121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c283bd0>
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_4463f5dc18e52d5b5f932b26ff8f76a6.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_4463f5dc18e52d5b5f932b26ff8f76a6.jpg saved to cache
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:43 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940
2026-03-28 09:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60156fbb-2377-5519-b136-be64270d3345 with scrape type 1
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60156fbb-2377-5519-b136-be64270d3345
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_adcd21bc42e4c6a94e0033017129f719.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_adcd21bc42e4c6a94e0033017129f719.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_db262b7595e5cbfce91ff7897e21e19b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_db262b7595e5cbfce91ff7897e21e19b.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_e843cede83fea931ccb311b4da551f2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_e843cede83fea931ccb311b4da551f2a.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_fb59e10043e4eadd843d53b4917d4556.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_fb59e10043e4eadd843d53b4917d4556.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_6eea903967ac3fefd32f94b73ee5977d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_6eea903967ac3fefd32f94b73ee5977d.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_2057404b14ad6029ee983beab0f3b462.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_2057404b14ad6029ee983beab0f3b462.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_eaafb0267ee56f6992389ad4019289d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_eaafb0267ee56f6992389ad4019289d2.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_9903b21eb7529533e97bba0139c81d21.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_9903b21eb7529533e97bba0139c81d21.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_3e46c2bd3a4a5c64069a1977d2f119a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_3e46c2bd3a4a5c64069a1977d2f119a2.jpg already downloaded
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd0%252F2ed0b89f104207f7565d6fb4fe2c0d66%252Fpa%252FUW00940_a4680a1107d185d0643ea3b77fd727e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_a4680a1107d185d0643ea3b77fd727e9.jpg already downloaded
2026-03-28 09:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60156fbb-2377-5519-b136-be64270d3345, identifier: UW00940
2026-03-28 09:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_cf38357147d0c5f033bc06c07852dfbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 09:06:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940
2026-03-28 09:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940 to the API
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW00940>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'hybrid',
 'id': '60156fbb-2377-5519-b136-be64270d3345',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW00940',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 105731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_adcd21bc42e4c6a94e0033017129f719.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_db262b7595e5cbfce91ff7897e21e19b.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_e843cede83fea931ccb311b4da551f2a.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_fb59e10043e4eadd843d53b4917d4556.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_6eea903967ac3fefd32f94b73ee5977d.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_2057404b14ad6029ee983beab0f3b462.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_eaafb0267ee56f6992389ad4019289d2.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_9903b21eb7529533e97bba0139c81d21.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_3e46c2bd3a4a5c64069a1977d2f119a2.jpg',
                'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_a4680a1107d185d0643ea3b77fd727e9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_adcd21bc42e4c6a94e0033017129f719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_db262b7595e5cbfce91ff7897e21e19b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_e843cede83fea931ccb311b4da551f2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_fb59e10043e4eadd843d53b4917d4556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_6eea903967ac3fefd32f94b73ee5977d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_2057404b14ad6029ee983beab0f3b462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_eaafb0267ee56f6992389ad4019289d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_9903b21eb7529533e97bba0139c81d21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_3e46c2bd3a4a5c64069a1977d2f119a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60156fbb-2377-5519-b136-be64270d3345/60156fbb-2377-5519-b136-be64270d3345_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d0/2ed0b89f104207f7565d6fb4fe2c0d66/pa/UW00940_a4680a1107d185d0643ea3b77fd727e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2022}
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW00940%27 HTTP/1.1" 200 None
2026-03-28 09:06:44 [auto1.it] INFO: Saving data for UW00940: {'created_time': 1774688804.647924, 'last_price_update_time': 1774688804.647969, 'auction_closing_time': 1774883625.0}
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW00940') HTTP/1.1" 204 0
2026-03-28 09:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_cd2b7ef1a31b192c8b2f2c8aab97eeee.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_18a8a743aabe178f2be8cbbd242c0a3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: MF09411
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA22015%27 HTTP/1.1" 200 None
2026-03-28 09:06:44 [auto1.it] INFO: Scrape type for VA22015: 0
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: RJ99533
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: MW88015
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW88015%27 HTTP/1.1" 200 None
2026-03-28 09:06:44 [auto1.it] INFO: Scrape type for MW88015: 0
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: BZ76072
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ76072%27 HTTP/1.1" 200 None
2026-03-28 09:06:44 [auto1.it] INFO: Scrape type for BZ76072: 0
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: MY09959
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY09959%27 HTTP/1.1" 200 None
2026-03-28 09:06:44 [auto1.it] INFO: Scrape type for MY09959: 0
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: YD29186
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: MC88266
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: NY04443
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: AR32020
2026-03-28 09:06:44 [auto1.it] INFO: Found listing with ID: XU30878
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU30878%27 HTTP/1.1" 200 None
2026-03-28 09:06:44 [auto1.it] INFO: Scrape type for XU30878: 2
2026-03-28 09:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d5c0c27-3cef-569e-a16d-7bbaea63058b with identifier: XU30878
2026-03-28 09:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d5c0c27-3cef-569e-a16d-7bbaea63058b with scrape type 2
2026-03-28 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d5c0c27-3cef-569e-a16d-7bbaea63058b with scrape type 2
2026-03-28 09:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d5c0c27-3cef-569e-a16d-7bbaea63058b, identifier: XU30878
2026-03-28 09:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_a457d0568fd37277ef3e9a73b88d2af7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_99fc2bf110eecfd32ec8e4184e4f246d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d5c0c27-3cef-569e-a16d-7bbaea63058b with identifier: XU30878
2026-03-28 09:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d5c0c27-3cef-569e-a16d-7bbaea63058b with identifier: XU30878
2026-03-28 09:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d5c0c27-3cef-569e-a16d-7bbaea63058b with identifier: XU30878 to the API
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:11:06Z',
 'fuel_type': 'diesel',
 'id': '0d5c0c27-3cef-569e-a16d-7bbaea63058b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU30878',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 164460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU30878%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Saving data for XU30878: {'auction_closing_time': 1774714266.0, 'created_time': 1774473148.090181, 'last_price_update_time': 1774688805.267294}
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU30878') HTTP/1.1" 204 0
2026-03-28 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR04246> (referer: https://www.auto1.com/v1/car-details-view/DR04246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG64342> (referer: https://www.auto1.com/v1/car-details-view/AG64342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_fe95a463d68e8de90e0c320ae14433c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: AZ02575
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02861%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for WB02861: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: XT03089
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT03089%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for XT03089: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: XT75480
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT75480%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for XT75480: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: TL73413
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: BZ22923
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ22923%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for BZ22923: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: MA55202
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA55202%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for MA55202: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: EA99389
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99389%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for EA99389: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: HD69020
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD62614%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for DD62614: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: ML25161
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML25161%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for ML25161: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: BY85548
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: AH40154
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH40154%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for AH40154: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: TZ90103
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: KL07491
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: HH04548
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH04548%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for HH04548: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY96828%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for VY96828: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: GS67606
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS67606%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for GS67606: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV06948%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for PV06948: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: SD07666
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: CM02924
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA61571%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for DA61571: 0
2026-03-28 09:06:45 [auto1.it] INFO: Found listing with ID: HY12574
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY12574%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [auto1.it] INFO: Scrape type for HY12574: 0
2026-03-28 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM70792> (referer: https://www.auto1.com/v1/car-details-view/MM70792/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346
2026-03-28 09:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with scrape type 1
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_3ee18785d2eddd07dc9a2c1a9c8fe804.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ee18785d2eddd07dc9a2c1a9c8fe804.jpg not downloaded yet
2026-03-28 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0e4a90>
2026-03-28 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_4d7631bbeb5eac3f7277aa3e4e3047f8.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_4d7631bbeb5eac3f7277aa3e4e3047f8.jpg saved to cache
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 106f47da-14b9-5c47-a547-cea8110544c4
2026-03-28 09:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579
2026-03-28 09:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with scrape type 1
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_10fcef8e626d269f3ebc7dd1e448ebca.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_10fcef8e626d269f3ebc7dd1e448ebca.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_2a8447e9a12a5919802544153b7f30dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_2a8447e9a12a5919802544153b7f30dc.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_a38648e10ea5c8c1f9140bfab74641a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_a38648e10ea5c8c1f9140bfab74641a9.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_4f8ba2f668c888456549489f940d3003.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_4f8ba2f668c888456549489f940d3003.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_0c380b7fdb74875ac9b5ab4543703643.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_0c380b7fdb74875ac9b5ab4543703643.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_4a144e1c9f10f2f57d956812e76aea62.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_4a144e1c9f10f2f57d956812e76aea62.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_9871a159cc4eb90a3a14edb77be6ed84.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_9871a159cc4eb90a3a14edb77be6ed84.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_f42abb9186fe2335cb65ae062c178ad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_f42abb9186fe2335cb65ae062c178ad1.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_fd8e708e9521798f101c429913d390a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_fd8e708e9521798f101c429913d390a7.jpg already downloaded
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F92%252Fbd920cd924e0a9ebfb5d793031012f51%252Fpa%252FVP67579_3d6f9c0c3b553a762d7b7270ef4b7fae.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_3d6f9c0c3b553a762d7b7270ef4b7fae.jpg already downloaded
2026-03-28 09:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5, identifier: VP67579
2026-03-28 09:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121
2026-03-28 09:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with scrape type 1
2026-03-28 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_046424d888a2b693f4cb74b76c5b3bf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_046424d888a2b693f4cb74b76c5b3bf7.jpg not downloaded yet
2026-03-28 09:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2e4390>
2026-03-28 09:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F3c%252Fdd3c421b08a7d5d05a1ab4126e1e42e1%252Fpa%252FXK62729_cf38357147d0c5f033bc06c07852dfbf.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_cf38357147d0c5f033bc06c07852dfbf.jpg saved to cache
2026-03-28 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffbc101d-1cce-5619-9943-d813bcfb86bc
2026-03-28 09:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffbc101d-1cce-5619-9943-d813bcfb86bc, skipping ID generation
2026-03-28 09:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbc101d-1cce-5619-9943-d813bcfb86bc with scrape type 1
2026-03-28 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffbc101d-1cce-5619-9943-d813bcfb86bc sending to next pipeline
2026-03-28 09:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffbc101d-1cce-5619-9943-d813bcfb86bc, identifier: XK62729
2026-03-28 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_1a78d1a793fa5c3e1e74748dcbb2a81a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_f89e4d0b095b4724102d36ac1c51ff20.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579
2026-03-28 09:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579
2026-03-28 09:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579 to the API
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP67579>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:45:46Z',
 'fuel_type': 'petrol',
 'id': '17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP67579',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 112384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_10fcef8e626d269f3ebc7dd1e448ebca.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_2a8447e9a12a5919802544153b7f30dc.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_a38648e10ea5c8c1f9140bfab74641a9.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_4f8ba2f668c888456549489f940d3003.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_0c380b7fdb74875ac9b5ab4543703643.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_4a144e1c9f10f2f57d956812e76aea62.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_9871a159cc4eb90a3a14edb77be6ed84.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_f42abb9186fe2335cb65ae062c178ad1.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_fd8e708e9521798f101c429913d390a7.jpg',
                'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_3d6f9c0c3b553a762d7b7270ef4b7fae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_10fcef8e626d269f3ebc7dd1e448ebca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_2a8447e9a12a5919802544153b7f30dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_a38648e10ea5c8c1f9140bfab74641a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_4f8ba2f668c888456549489f940d3003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_0c380b7fdb74875ac9b5ab4543703643.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_4a144e1c9f10f2f57d956812e76aea62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_9871a159cc4eb90a3a14edb77be6ed84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_f42abb9186fe2335cb65ae062c178ad1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_fd8e708e9521798f101c429913d390a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5/17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/92/bd920cd924e0a9ebfb5d793031012f51/pa/VP67579_3d6f9c0c3b553a762d7b7270ef4b7fae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP67579%27 HTTP/1.1" 200 None
2026-03-28 09:06:46 [auto1.it] INFO: Saving data for VP67579: {'created_time': 1774688806.589235, 'last_price_update_time': 1774688806.589245, 'auction_closing_time': 1774885546.0}
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP67579') HTTP/1.1" 204 0
2026-03-28 09:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729
2026-03-28 09:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729
2026-03-28 09:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729 to the API
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_cf38357147d0c5f033bc06c07852dfbf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:08:00Z',
 'fuel_type': 'diesel',
 'id': 'ffbc101d-1cce-5619-9943-d813bcfb86bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK62729',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 170446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_2d6b3db1790d0ae62513dd5d05880b31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_46b3f2a49d8e3c73e58a61b3cc1bfd77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7a32415f99c0f494efc10407e160ce56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_a7e41c179458d9f743ca0b92bbbf9439.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_aef504e21c2fe1efd69b782db5692bec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_5a395648350da07d564a4631393111de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_cf38357147d0c5f033bc06c07852dfbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_7366473108e7fee42d06501d75a3cee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_53ef978a65acb1ea1d822301358b2767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc101d-1cce-5619-9943-d813bcfb86bc/ffbc101d-1cce-5619-9943-d813bcfb86bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/3c/dd3c421b08a7d5d05a1ab4126e1e42e1/pa/XK62729_55d4e7976ef1a2c0f9eed5764e08092d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2018}
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK62729%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [auto1.it] INFO: Saving data for XK62729: {'created_time': 1774688807.074228, 'last_price_update_time': 1774688807.074241, 'auction_closing_time': 1774883280.0}
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XK62729') HTTP/1.1" 204 0
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_63feadb37474d5a8973afcfc12063b4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_63feadb37474d5a8973afcfc12063b4a.jpg not downloaded yet
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_1448ed284bff431897c2137a4c9b253a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_1448ed284bff431897c2137a4c9b253a.jpg not downloaded yet
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2e4950>
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_cd2b7ef1a31b192c8b2f2c8aab97eeee.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_cd2b7ef1a31b192c8b2f2c8aab97eeee.jpg saved to cache
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2de190>
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_18a8a743aabe178f2be8cbbd242c0a3a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_18a8a743aabe178f2be8cbbd242c0a3a.jpg saved to cache
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 106f47da-14b9-5c47-a547-cea8110544c4
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06599190>
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_a457d0568fd37277ef3e9a73b88d2af7.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_a457d0568fd37277ef3e9a73b88d2af7.jpg saved to cache
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 106f47da-14b9-5c47-a547-cea8110544c4
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c282490>
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_99fc2bf110eecfd32ec8e4184e4f246d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_99fc2bf110eecfd32ec8e4184e4f246d.jpg saved to cache
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 106f47da-14b9-5c47-a547-cea8110544c4
2026-03-28 09:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa50a3f9-1a16-5cf7-8d6b-af01d61dea68 with identifier: DR04246
2026-03-28 09:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68 with scrape type 1
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_36e8dd0901d45b27cb0a567591722453.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_36e8dd0901d45b27cb0a567591722453.jpg not downloaded yet
2026-03-28 09:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342
2026-03-28 09:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with scrape type 1
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e55afa9-7e7f-59a0-9331-bc794f9c9188
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_f8e856a9c42aeada1c7daf4c4eaa201b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_f8e856a9c42aeada1c7daf4c4eaa201b.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_bd07a0c37fd6ea5dd33cdf2d0a282fb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_bd07a0c37fd6ea5dd33cdf2d0a282fb8.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_292ebabc9752bcb78ca9f7e426bf1000.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_292ebabc9752bcb78ca9f7e426bf1000.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_b496c49bc6cfebe5d2e813480f708796.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_b496c49bc6cfebe5d2e813480f708796.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_20a37a1630d13e968b01330030a93b21.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_20a37a1630d13e968b01330030a93b21.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_ddc65d769a751dbe2e5c69c06b82bbc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_ddc65d769a751dbe2e5c69c06b82bbc2.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_4ab47fbd6d7e0e8877089fb6f72fcc5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_4ab47fbd6d7e0e8877089fb6f72fcc5f.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_6417253e38a24afc929d38b69ed041ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_6417253e38a24afc929d38b69ed041ef.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_f22d1203881f0fb129f25d91c2ca323b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_f22d1203881f0fb129f25d91c2ca323b.jpg already downloaded
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa8%252F6ca80fa5b0bf86d12a39719e9fea3415%252Fpa%252FAG64342_9f149d2707f3be6d1e459fefd22445d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_9f149d2707f3be6d1e459fefd22445d0.jpg already downloaded
2026-03-28 09:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e55afa9-7e7f-59a0-9331-bc794f9c9188, identifier: AG64342
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0672c290>
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_fe95a463d68e8de90e0c320ae14433c0.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_fe95a463d68e8de90e0c320ae14433c0.jpg saved to cache
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792
2026-03-28 09:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with scrape type 1
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_1a39ee8918e9c13c0f9b17af5737136e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_1a39ee8918e9c13c0f9b17af5737136e.jpg not downloaded yet
2026-03-28 09:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_6fea7b68af4628dddd8789f58507818e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_c032bb405ff411908468de7a9f6e4e61.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_c032bb405ff411908468de7a9f6e4e61.jpg not downloaded yet
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_8f59746b90eac3cd12913034f24bb201.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_8f59746b90eac3cd12913034f24bb201.jpg not downloaded yet
2026-03-28 09:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342
2026-03-28 09:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342
2026-03-28 09:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342 to the API
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AG64342>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:07:19Z',
 'fuel_type': 'diesel',
 'id': '8e55afa9-7e7f-59a0-9331-bc794f9c9188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG64342',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'BMW',
 'model': '3er',
 'odometer': 134730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_f8e856a9c42aeada1c7daf4c4eaa201b.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_bd07a0c37fd6ea5dd33cdf2d0a282fb8.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_292ebabc9752bcb78ca9f7e426bf1000.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_b496c49bc6cfebe5d2e813480f708796.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_20a37a1630d13e968b01330030a93b21.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_ddc65d769a751dbe2e5c69c06b82bbc2.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_4ab47fbd6d7e0e8877089fb6f72fcc5f.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_6417253e38a24afc929d38b69ed041ef.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_f22d1203881f0fb129f25d91c2ca323b.jpg',
                'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_9f149d2707f3be6d1e459fefd22445d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_f8e856a9c42aeada1c7daf4c4eaa201b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252061,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_bd07a0c37fd6ea5dd33cdf2d0a282fb8.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_292ebabc9752bcb78ca9f7e426bf1000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_b496c49bc6cfebe5d2e813480f708796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_20a37a1630d13e968b01330030a93b21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_ddc65d769a751dbe2e5c69c06b82bbc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_4ab47fbd6d7e0e8877089fb6f72fcc5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_6417253e38a24afc929d38b69ed041ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_f22d1203881f0fb129f25d91c2ca323b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e55afa9-7e7f-59a0-9331-bc794f9c9188/8e55afa9-7e7f-59a0-9331-bc794f9c9188_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a8/6ca80fa5b0bf86d12a39719e9fea3415/pa/AG64342_9f149d2707f3be6d1e459fefd22445d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG64342%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [auto1.it] INFO: Saving data for AG64342: {'created_time': 1774688808.006134, 'last_price_update_time': 1774688808.006143, 'auction_closing_time': 1774883239.0}
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG64342') HTTP/1.1" 204 0
2026-03-28 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_b5e05a0b13c6992b872954170356d3de.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_7ec4d9bae2fbc830321e394990205a98.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_7ec4d9bae2fbc830321e394990205a98.jpg not downloaded yet
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_040290b34bd7d82efaeff1966c510013.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_040290b34bd7d82efaeff1966c510013.jpg not downloaded yet
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c172fd0>
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_1a78d1a793fa5c3e1e74748dcbb2a81a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_1a78d1a793fa5c3e1e74748dcbb2a81a.jpg saved to cache
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06766990>
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F8b%252F538bb6c21a18e303c59afcfcd4701c21%252Fpa%252FMH04778_f89e4d0b095b4724102d36ac1c51ff20.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_f89e4d0b095b4724102d36ac1c51ff20.jpg saved to cache
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 106f47da-14b9-5c47-a547-cea8110544c4
2026-03-28 09:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 106f47da-14b9-5c47-a547-cea8110544c4, skipping ID generation
2026-03-28 09:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106f47da-14b9-5c47-a547-cea8110544c4 with scrape type 1
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 106f47da-14b9-5c47-a547-cea8110544c4 sending to next pipeline
2026-03-28 09:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 106f47da-14b9-5c47-a547-cea8110544c4, identifier: MH04778
2026-03-28 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_7f498683fd01483e8b15edd0eadd6380.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_9a7acef5141d687237d24c551ffb71cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_3344000c4d84f37803a762d7a742cbea.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_f37d2d99ad30e438b40d50aa22a95724.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f37d2d99ad30e438b40d50aa22a95724.jpg not downloaded yet
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_0219b25e61b45715b39f3f77c9cf483c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0219b25e61b45715b39f3f77c9cf483c.jpg not downloaded yet
2026-03-28 09:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778
2026-03-28 09:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778
2026-03-28 09:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778 to the API
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_f89e4d0b095b4724102d36ac1c51ff20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:48:28Z',
 'fuel_type': 'diesel',
 'id': '106f47da-14b9-5c47-a547-cea8110544c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH04778',
 'listing': 'auction',
 'location': 'IT, Piacenza',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 195041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_4d7631bbeb5eac3f7277aa3e4e3047f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_18a8a743aabe178f2be8cbbd242c0a3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_99fc2bf110eecfd32ec8e4184e4f246d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_a457d0568fd37277ef3e9a73b88d2af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106f47da-14b9-5c47-a547-cea8110544c4/106f47da-14b9-5c47-a547-cea8110544c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/8b/538bb6c21a18e303c59afcfcd4701c21/pa/MH04778_f89e4d0b095b4724102d36ac1c51ff20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi VGT Dynamic',
 'transmission': 'automatic',
 'trim': 'VGT Dynamic',
 'year': 2008}
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH04778%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [auto1.it] INFO: Saving data for MH04778: {'created_time': 1774688808.639739, 'last_price_update_time': 1774688808.63975, 'auction_closing_time': 1774885708.0}
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH04778') HTTP/1.1" 204 0
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_5e70f25fdd7689ce7447fd810906213e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5e70f25fdd7689ce7447fd810906213e.jpg not downloaded yet
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_5e5ecfb565aee3110ae3e42c90a2a95f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_5e5ecfb565aee3110ae3e42c90a2a95f.jpg not downloaded yet
2026-03-28 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f8ee48513e81b08a3a537dc55d9ad101.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_3ba7d22fbdc6180baa962f55b0b32892.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ba7d22fbdc6180baa962f55b0b32892.jpg not downloaded yet
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_0207396e8113bf03a035a922517ec97d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0207396e8113bf03a035a922517ec97d.jpg not downloaded yet
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066a5bd0>
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_6fea7b68af4628dddd8789f58507818e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_6fea7b68af4628dddd8789f58507818e.jpg saved to cache
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 867f7bec-ab0d-5cac-9780-7aeddac0960f
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067130d0>
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_b5e05a0b13c6992b872954170356d3de.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_b5e05a0b13c6992b872954170356d3de.jpg saved to cache
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_e951b159ceb85c7bba015c5bdc2424e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_301c8ad909c2f1f226a9d9cdbad63228.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_301c8ad909c2f1f226a9d9cdbad63228.jpg not downloaded yet
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_bef03e02222ce548d8da891cbbd1df56.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_bef03e02222ce548d8da891cbbd1df56.jpg not downloaded yet
2026-03-28 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW35507> (referer: https://www.auto1.com/v1/car-details-view/NW35507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_70606990921e2c28727e9f010bbc9e04.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_70606990921e2c28727e9f010bbc9e04.jpg not downloaded yet
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_2126f2f82e7c37c2ae0ade2b2b73baab.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_2126f2f82e7c37c2ae0ade2b2b73baab.jpg not downloaded yet
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0622f9d0>
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_7f498683fd01483e8b15edd0eadd6380.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_7f498683fd01483e8b15edd0eadd6380.jpg saved to cache
2026-03-28 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067665d0>
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_9a7acef5141d687237d24c551ffb71cd.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_9a7acef5141d687237d24c551ffb71cd.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 867f7bec-ab0d-5cac-9780-7aeddac0960f
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c172bd0>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_3344000c4d84f37803a762d7a742cbea.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_3344000c4d84f37803a762d7a742cbea.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_1448ed284bff431897c2137a4c9b253a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_5b2d7ce47d3a6e410666d0fe2fca72ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5b2d7ce47d3a6e410666d0fe2fca72ef.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_d46ee26ad1707f63bb24b7404171159e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_d46ee26ad1707f63bb24b7404171159e.jpg not downloaded yet
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061ddd90>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_f8ee48513e81b08a3a537dc55d9ad101.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f8ee48513e81b08a3a537dc55d9ad101.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 867f7bec-ab0d-5cac-9780-7aeddac0960f
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_8f59746b90eac3cd12913034f24bb201.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_398dc99f5370fc93e396236ee8cc07aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_275cbae48e0d059e2a362d2864557100.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_1a39ee8918e9c13c0f9b17af5737136e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_d8da00f52415af80cea5c14a928521b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_d8da00f52415af80cea5c14a928521b2.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_bfa962a70a3832ffa3e4e9f3d66fa920.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_bfa962a70a3832ffa3e4e9f3d66fa920.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_917a6effe5863a782096d59ef1299adc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_917a6effe5863a782096d59ef1299adc.jpg not downloaded yet
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB22824> (referer: https://www.auto1.com/v1/car-details-view/MB22824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2d1150>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_e951b159ceb85c7bba015c5bdc2424e3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_e951b159ceb85c7bba015c5bdc2424e3.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e
2026-03-28 09:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507
2026-03-28 09:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c3575-20ed-5a1e-a32e-504237c9db68 with scrape type 1
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_4484762a4726ed586ef4ac14e7b2ae33.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4484762a4726ed586ef4ac14e7b2ae33.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_51a6423061cbf718744664ed47a92c5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_51a6423061cbf718744664ed47a92c5d.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_052fe9af2dacb133c72e3322a370af89.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_052fe9af2dacb133c72e3322a370af89.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_aafc516039e9b0d6fc98475f2cee3a10.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_aafc516039e9b0d6fc98475f2cee3a10.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_9705b75aa0d438c0cc5e9f08093ecbbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_9705b75aa0d438c0cc5e9f08093ecbbe.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_f897934b5d77597f9d4d3cf87eddfea6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f897934b5d77597f9d4d3cf87eddfea6.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_d2283278ba56a87ae8e0c028c875dc70.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_d2283278ba56a87ae8e0c028c875dc70.jpg not downloaded yet
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2d3790>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_1448ed284bff431897c2137a4c9b253a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_1448ed284bff431897c2137a4c9b253a.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c07ae10>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_8f59746b90eac3cd12913034f24bb201.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_8f59746b90eac3cd12913034f24bb201.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06759dd0>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F86%252F698637eda1ccbc786819d9a10c7e7dc1%252Fpa%252FGP46420_398dc99f5370fc93e396236ee8cc07aa.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_398dc99f5370fc93e396236ee8cc07aa.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67e9f24f-19d7-5232-a322-19d30db54d3d
2026-03-28 09:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67e9f24f-19d7-5232-a322-19d30db54d3d, skipping ID generation
2026-03-28 09:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e9f24f-19d7-5232-a322-19d30db54d3d with scrape type 1
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67e9f24f-19d7-5232-a322-19d30db54d3d sending to next pipeline
2026-03-28 09:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67e9f24f-19d7-5232-a322-19d30db54d3d, identifier: GP46420
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06258610>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f6df04cabf3aec134ee62c0c76dfd%252Fpa%252FPD30072_275cbae48e0d059e2a362d2864557100.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_275cbae48e0d059e2a362d2864557100.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 867f7bec-ab0d-5cac-9780-7aeddac0960f
2026-03-28 09:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 867f7bec-ab0d-5cac-9780-7aeddac0960f, skipping ID generation
2026-03-28 09:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867f7bec-ab0d-5cac-9780-7aeddac0960f with scrape type 1
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 867f7bec-ab0d-5cac-9780-7aeddac0960f sending to next pipeline
2026-03-28 09:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 867f7bec-ab0d-5cac-9780-7aeddac0960f, identifier: PD30072
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1c4a50>
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_1a39ee8918e9c13c0f9b17af5737136e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_1a39ee8918e9c13c0f9b17af5737136e.jpg saved to cache
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8
2026-03-28 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_c032bb405ff411908468de7a9f6e4e61.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_d11a6f1bdfe6cdcfba84d0eb66af634b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_d11a6f1bdfe6cdcfba84d0eb66af634b.jpg not downloaded yet
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_cea3d51482e8fbccd70e011ff8e0b0e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_cea3d51482e8fbccd70e011ff8e0b0e8.jpg not downloaded yet
2026-03-28 09:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420
2026-03-28 09:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420
2026-03-28 09:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420 to the API
2026-03-28 09:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_398dc99f5370fc93e396236ee8cc07aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.7L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:46Z',
 'fuel_type': 'diesel',
 'id': '67e9f24f-19d7-5232-a322-19d30db54d3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP46420',
 'listing': 'auction',
 'location': 'IT, Frosinone',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 330213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4c6dc2d313d45b958bfedc02cd57015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_398dc99f5370fc93e396236ee8cc07aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_3344000c4d84f37803a762d7a742cbea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_b5e05a0b13c6992b872954170356d3de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_d4ce6cd3421e9e94ca21d81000d012d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_1ce07c98344ee1279209433e7ef3c358.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_f5f119c3319d48e506950b3fc9006021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_cca31cc193d74d667600842c8deb9fb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_7e5c319dce39ab3b9fa1cbe608219707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e9f24f-19d7-5232-a322-19d30db54d3d/67e9f24f-19d7-5232-a322-19d30db54d3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/86/698637eda1ccbc786819d9a10c7e7dc1/pa/GP46420_ed726c0a049255c60444023bd6fdd7e7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Xpossible ISG 2WD',
 'transmission': 'automatic',
 'trim': 'Xpossible ISG 2WD',
 'year': 2016}
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP46420%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Saving data for GP46420: {'created_time': 1774688810.18422, 'last_price_update_time': 1774688810.184231, 'auction_closing_time': 1774885126.0}
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GP46420') HTTP/1.1" 204 0
2026-03-28 09:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072
2026-03-28 09:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072
2026-03-28 09:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072 to the API
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_275cbae48e0d059e2a362d2864557100.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'petrol',
 'id': '867f7bec-ab0d-5cac-9780-7aeddac0960f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD30072',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 85517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_d4027fc9e4247c9e3a7e0552bc4d3852.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_275cbae48e0d059e2a362d2864557100.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f8ee48513e81b08a3a537dc55d9ad101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_9a7acef5141d687237d24c551ffb71cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_6fea7b68af4628dddd8789f58507818e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867f7bec-ab0d-5cac-9780-7aeddac0960f/867f7bec-ab0d-5cac-9780-7aeddac0960f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f6df04cabf3aec134ee62c0c76dfd/pa/PD30072_f27e8dc6c579ebbf8b975f915f3af6fe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD30072%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Saving data for PD30072: {'created_time': 1774688810.536515, 'last_price_update_time': 1774688810.536525, 'auction_closing_time': 1774884104.0}
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD30072') HTTP/1.1" 204 0
2026-03-28 09:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0219b25e61b45715b39f3f77c9cf483c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0207396e8113bf03a035a922517ec97d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_db876a860eadd2985c11f5aa0bfa3249.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_db876a860eadd2985c11f5aa0bfa3249.jpg not downloaded yet
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_0e680148b2a88040c4276f881b379139.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0e680148b2a88040c4276f881b379139.jpg not downloaded yet
2026-03-28 09:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_5e5ecfb565aee3110ae3e42c90a2a95f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_b42a35bdf15145baed60ada9bd5e0b42.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_b42a35bdf15145baed60ada9bd5e0b42.jpg not downloaded yet
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_7170a94f73d578f629a771ea17db8f75.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_7170a94f73d578f629a771ea17db8f75.jpg not downloaded yet
2026-03-28 09:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC92896> (referer: https://www.auto1.com/v1/car-details-view/RC92896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:50 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3439 | hits on page: 40
2026-03-28 09:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824
2026-03-28 09:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8576450-9316-5576-a88a-8201fbf05cc8 with scrape type 1
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_8891c10ce1fc3b642e3943c41e9cf2da.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_8891c10ce1fc3b642e3943c41e9cf2da.jpg not downloaded yet
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_9d46392eec4cdd0666f69028874e894d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_9d46392eec4cdd0666f69028874e894d.jpg not downloaded yet
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_2a86d26cfa6d982505d189904861ddef.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_2a86d26cfa6d982505d189904861ddef.jpg not downloaded yet
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: AR31382
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: BT73754
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: GY59997
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: BR84654
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: JG32335
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: HA49893
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: UE49682
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: HZ21842
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ21842%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for HZ21842: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: VF12324
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: RF17009
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: GR59213
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: SF89201
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF89201%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for SF89201: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: PG27955
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: KD33461
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD33461%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for KD33461: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: XY30462
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY30462%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for XY30462: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV07226%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for UV07226: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: WC70760
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: ZH02661
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: MP98273
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: HK97988
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: SJ75121
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ75121%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for SJ75121: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: UU73428
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU73428%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for UU73428: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM82110%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for MM82110: 0
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-28 09:06:50 [auto1.it] INFO: Found listing with ID: KE50843
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE50843%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [auto1.it] INFO: Scrape type for KE50843: 2
2026-03-28 09:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0d109e6-02e4-50c8-afbd-54cda0a1b203 with identifier: KE50843
2026-03-28 09:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0d109e6-02e4-50c8-afbd-54cda0a1b203 with scrape type 2
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0d109e6-02e4-50c8-afbd-54cda0a1b203 with scrape type 2
2026-03-28 09:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0d109e6-02e4-50c8-afbd-54cda0a1b203, identifier: KE50843
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_79eb24ad1010fdabfc40c16ee9773081.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_79eb24ad1010fdabfc40c16ee9773081.jpg not downloaded yet
2026-03-28 09:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0675c210>
2026-03-28 09:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_c032bb405ff411908468de7a9f6e4e61.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_c032bb405ff411908468de7a9f6e4e61.jpg saved to cache
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0d109e6-02e4-50c8-afbd-54cda0a1b203 with identifier: KE50843
2026-03-28 09:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0d109e6-02e4-50c8-afbd-54cda0a1b203 with identifier: KE50843
2026-03-28 09:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0d109e6-02e4-50c8-afbd-54cda0a1b203 with identifier: KE50843 to the API
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:06:18Z',
 'fuel_type': 'diesel',
 'id': 'f0d109e6-02e4-50c8-afbd-54cda0a1b203',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE50843',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 97274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-30',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE50843%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Saving data for KE50843: {'auction_closing_time': 1774713978.0, 'created_time': 1774473162.788654, 'last_price_update_time': 1774688811.305081}
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE50843') HTTP/1.1" 204 0
2026-03-28 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_d46ee26ad1707f63bb24b7404171159e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_97bff8f44b5145558318511a2b9cf879.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_97bff8f44b5145558318511a2b9cf879.jpg not downloaded yet
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: MN43509
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: FV31205
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: ZS50484
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS50484%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for ZS50484: 0
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM76846%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for JM76846: 0
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV87912%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for CV87912: 0
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG74352%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for XG74352: 0
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: RH02265
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: PF24041
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF24041%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for PF24041: 0
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: AT64434
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT64434%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for AT64434: 0
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: PC87796
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC87796%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for PC87796: 0
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: YS50306
2026-03-28 09:06:51 [auto1.it] INFO: Found listing with ID: UF44040
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF44040%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [auto1.it] INFO: Scrape type for UF44040: 0
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_898d5e386deebe10b4d959d30e1e6b4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_898d5e386deebe10b4d959d30e1e6b4c.jpg not downloaded yet
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1e6e90>
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_0219b25e61b45715b39f3f77c9cf483c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0219b25e61b45715b39f3f77c9cf483c.jpg saved to cache
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066b0cd0>
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_0207396e8113bf03a035a922517ec97d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0207396e8113bf03a035a922517ec97d.jpg saved to cache
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_bef03e02222ce548d8da891cbbd1df56.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_2126f2f82e7c37c2ae0ade2b2b73baab.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_841bed0f86ee743770d60348423bd4d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_841bed0f86ee743770d60348423bd4d6.jpg not downloaded yet
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_b22bba32ec7b69c15266795d55431de5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_b22bba32ec7b69c15266795d55431de5.jpg not downloaded yet
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c062153d0>
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_5e5ecfb565aee3110ae3e42c90a2a95f.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_5e5ecfb565aee3110ae3e42c90a2a95f.jpg saved to cache
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8
2026-03-28 09:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896
2026-03-28 09:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9a4e72a-932f-5374-8e55-5294198d9e4c with scrape type 1
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_7c66fc9f19552035a242fdbf008922cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_7c66fc9f19552035a242fdbf008922cf.jpg not downloaded yet
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c144290>
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_d46ee26ad1707f63bb24b7404171159e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_d46ee26ad1707f63bb24b7404171159e.jpg saved to cache
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_f4482ea5c113dba5080f23a283b3078d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_f4482ea5c113dba5080f23a283b3078d.jpg not downloaded yet
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_552c5085e0186f4f6def93a94ed8a5d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_552c5085e0186f4f6def93a94ed8a5d1.jpg not downloaded yet
2026-03-28 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_f981811bac556370183eebfadf80cdc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_26a4b6236b198c7111f7e84edacbd688.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_26a4b6236b198c7111f7e84edacbd688.jpg not downloaded yet
2026-03-28 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_bfa962a70a3832ffa3e4e9f3d66fa920.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_0e2c3b697862bd72a0aababf2420d753.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_0e2c3b697862bd72a0aababf2420d753.jpg not downloaded yet
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_66da6024382f232efa4dec54837029dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_66da6024382f232efa4dec54837029dd.jpg not downloaded yet
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0670b310>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_bef03e02222ce548d8da891cbbd1df56.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_bef03e02222ce548d8da891cbbd1df56.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1fbc10>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_2126f2f82e7c37c2ae0ade2b2b73baab.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_2126f2f82e7c37c2ae0ade2b2b73baab.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_d8da00f52415af80cea5c14a928521b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_70606990921e2c28727e9f010bbc9e04.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_8570ca7e60bb34dbcbdd17b7e2bc28af.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_8570ca7e60bb34dbcbdd17b7e2bc28af.jpg not downloaded yet
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_4bc0059bb6be8ba7951b5ee71e5f091e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4bc0059bb6be8ba7951b5ee71e5f091e.jpg not downloaded yet
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_e6e14135df1ac3a926a4a2059e1c610a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e6e14135df1ac3a926a4a2059e1c610a.jpg not downloaded yet
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_78f52008c4a9e93286e10b8230f4a017.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_78f52008c4a9e93286e10b8230f4a017.jpg not downloaded yet
2026-03-28 09:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0e159a90>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_f981811bac556370183eebfadf80cdc3.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_f981811bac556370183eebfadf80cdc3.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db288d0>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_bfa962a70a3832ffa3e4e9f3d66fa920.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_bfa962a70a3832ffa3e4e9f3d66fa920.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_143c5a187d3257f498daae1a9855d136.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_143c5a187d3257f498daae1a9855d136.jpg not downloaded yet
2026-03-28 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_5a61251cbcb1ff11eeeeda8d35974c22.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_0ce67a42f590665b4f60cf694e9d9951.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_0ce67a42f590665b4f60cf694e9d9951.jpg not downloaded yet
2026-03-28 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_d2283278ba56a87ae8e0c028c875dc70.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_cea3d51482e8fbccd70e011ff8e0b0e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_1c0de57a7f035a4f79a1f5349e386e0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_1c0de57a7f035a4f79a1f5349e386e0b.jpg not downloaded yet
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061e4d90>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_d8da00f52415af80cea5c14a928521b2.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_d8da00f52415af80cea5c14a928521b2.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0b22d0>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_70606990921e2c28727e9f010bbc9e04.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_70606990921e2c28727e9f010bbc9e04.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_2a9cb216844f96d74b95dff045439276.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_2a9cb216844f96d74b95dff045439276.jpg not downloaded yet
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_e7a2e0b35f9f5b737d594b65be9f88dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e7a2e0b35f9f5b737d594b65be9f88dc.jpg not downloaded yet
2026-03-28 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_d368aa0c33057f1f9a27635e284b04de.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_999e8adb185e5401827c1c184591c9fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_999e8adb185e5401827c1c184591c9fc.jpg not downloaded yet
2026-03-28 09:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065cf350>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F3f%252F3d3f997b298601980d1742b1918eedf1%252Fpa%252FHR61031_5a61251cbcb1ff11eeeeda8d35974c22.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_5a61251cbcb1ff11eeeeda8d35974c22.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06fc907a-d0b0-59af-818a-07274779fdab
2026-03-28 09:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06fc907a-d0b0-59af-818a-07274779fdab, skipping ID generation
2026-03-28 09:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06fc907a-d0b0-59af-818a-07274779fdab with scrape type 1
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06fc907a-d0b0-59af-818a-07274779fdab sending to next pipeline
2026-03-28 09:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06fc907a-d0b0-59af-818a-07274779fdab, identifier: HR61031
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1dd410>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_d2283278ba56a87ae8e0c028c875dc70.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_d2283278ba56a87ae8e0c028c875dc70.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1c3b90>
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_cea3d51482e8fbccd70e011ff8e0b0e8.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_cea3d51482e8fbccd70e011ff8e0b0e8.jpg saved to cache
2026-03-28 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031
2026-03-28 09:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031
2026-03-28 09:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031 to the API
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_5a61251cbcb1ff11eeeeda8d35974c22.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:14:44Z',
 'fuel_type': 'diesel',
 'id': '06fc907a-d0b0-59af-818a-07274779fdab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR61031',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 36842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_43beed1da32d8733b1147a3891ef7716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_684721a36021309b2da9c1d97332254e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_a018f5dfdf6131637b1809cd6884f6c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_b3e9e8fa2b2091b9e58b99be06de2c74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_cd2b7ef1a31b192c8b2f2c8aab97eeee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_e16f86602d65b66738fdb4afc48683d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_074537236bb5f5a5d15c7dde926417b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2222851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_f981811bac556370183eebfadf80cdc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_4463f5dc18e52d5b5f932b26ff8f76a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06fc907a-d0b0-59af-818a-07274779fdab/06fc907a-d0b0-59af-818a-07274779fdab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3112767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/3f/3d3f997b298601980d1742b1918eedf1/pa/HR61031_5a61251cbcb1ff11eeeeda8d35974c22.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.3 JTD Climbing 4x4',
 'transmission': 'manual',
 'trim': 'Climbing 4x4',
 'year': 2006}
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR61031%27 HTTP/1.1" 200 None
2026-03-28 09:06:53 [auto1.it] INFO: Saving data for HR61031: {'created_time': 1774688813.582243, 'last_price_update_time': 1774688813.582253, 'auction_closing_time': 1774883684.0}
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR61031') HTTP/1.1" 204 0
2026-03-28 09:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0e680148b2a88040c4276f881b379139.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_ffa655cc46b00cf25c876e91553e5b3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_ffa655cc46b00cf25c876e91553e5b3c.jpg not downloaded yet
2026-03-28 09:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_2a86d26cfa6d982505d189904861ddef.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1dea50>
2026-03-28 09:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F90%252F2b9034584b79437266da72c1490e897d%252Fpa%252FPZ74443_d368aa0c33057f1f9a27635e284b04de.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_d368aa0c33057f1f9a27635e284b04de.jpg saved to cache
2026-03-28 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fcbeaf6-ccb5-5903-89be-190be0822dba
2026-03-28 09:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fcbeaf6-ccb5-5903-89be-190be0822dba, skipping ID generation
2026-03-28 09:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcbeaf6-ccb5-5903-89be-190be0822dba with scrape type 1
2026-03-28 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fcbeaf6-ccb5-5903-89be-190be0822dba sending to next pipeline
2026-03-28 09:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1fcbeaf6-ccb5-5903-89be-190be0822dba, identifier: PZ74443
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_c811b7af7a2a7ab2c1ae7bc6c1790fd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_c811b7af7a2a7ab2c1ae7bc6c1790fd4.jpg not downloaded yet
2026-03-28 09:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443
2026-03-28 09:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443
2026-03-28 09:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443 to the API
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_d368aa0c33057f1f9a27635e284b04de.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:05:27Z',
 'fuel_type': 'diesel',
 'id': '1fcbeaf6-ccb5-5903-89be-190be0822dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ74443',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 213942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_715feb5843879af2d2c1d23d8e39997a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_e062b4e15befbfdb82068d9ccb967b76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_76dfd52ab8a0f764bdf00477c0c408f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_cc1c665e77be0a29586ba0940868bfa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_7415fe4764ef336cf0f49da5a45d8553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_68cc43833a23f94c43aa9495e13c0cb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_1a78d1a793fa5c3e1e74748dcbb2a81a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_d368aa0c33057f1f9a27635e284b04de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_fe95a463d68e8de90e0c320ae14433c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcbeaf6-ccb5-5903-89be-190be0822dba/1fcbeaf6-ccb5-5903-89be-190be0822dba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/90/2b9034584b79437266da72c1490e897d/pa/PZ74443_9ffbae4c53d038c9234a0aea4292850e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ74443%27 HTTP/1.1" 200 None
2026-03-28 09:06:54 [auto1.it] INFO: Saving data for PZ74443: {'created_time': 1774688814.289607, 'last_price_update_time': 1774688814.289617, 'auction_closing_time': 1774883127.0}
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ74443') HTTP/1.1" 204 0
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_552c5085e0186f4f6def93a94ed8a5d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_4b0d773a8a873e0664810f90dc4a5707.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_4b0d773a8a873e0664810f90dc4a5707.jpg not downloaded yet
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_f4482ea5c113dba5080f23a283b3078d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c74ff90>
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_0e680148b2a88040c4276f881b379139.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0e680148b2a88040c4276f881b379139.jpg saved to cache
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1dd610>
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_2a86d26cfa6d982505d189904861ddef.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_2a86d26cfa6d982505d189904861ddef.jpg saved to cache
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065cd290>
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_552c5085e0186f4f6def93a94ed8a5d1.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_552c5085e0186f4f6def93a94ed8a5d1.jpg saved to cache
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065cd390>
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_f4482ea5c113dba5080f23a283b3078d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_f4482ea5c113dba5080f23a283b3078d.jpg saved to cache
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_36e8dd0901d45b27cb0a567591722453.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5b2d7ce47d3a6e410666d0fe2fca72ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_d11a6f1bdfe6cdcfba84d0eb66af634b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_79eb24ad1010fdabfc40c16ee9773081.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_9705b75aa0d438c0cc5e9f08093ecbbe.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_9d46392eec4cdd0666f69028874e894d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_26a4b6236b198c7111f7e84edacbd688.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_7c66fc9f19552035a242fdbf008922cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0d0890>
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_36e8dd0901d45b27cb0a567591722453.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_36e8dd0901d45b27cb0a567591722453.jpg saved to cache
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_78f52008c4a9e93286e10b8230f4a017.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_0ce67a42f590665b4f60cf694e9d9951.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_ffa655cc46b00cf25c876e91553e5b3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_2a9cb216844f96d74b95dff045439276.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061dedd0>
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_5b2d7ce47d3a6e410666d0fe2fca72ef.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5b2d7ce47d3a6e410666d0fe2fca72ef.jpg saved to cache
2026-03-28 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0622ac50>
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_d11a6f1bdfe6cdcfba84d0eb66af634b.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_d11a6f1bdfe6cdcfba84d0eb66af634b.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1f9a90>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_79eb24ad1010fdabfc40c16ee9773081.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_79eb24ad1010fdabfc40c16ee9773081.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c062288d0>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_9705b75aa0d438c0cc5e9f08093ecbbe.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_9705b75aa0d438c0cc5e9f08093ecbbe.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0660dcd0>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_9d46392eec4cdd0666f69028874e894d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_9d46392eec4cdd0666f69028874e894d.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06515b10>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_26a4b6236b198c7111f7e84edacbd688.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_26a4b6236b198c7111f7e84edacbd688.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061d5ed0>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_7c66fc9f19552035a242fdbf008922cf.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_7c66fc9f19552035a242fdbf008922cf.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_4b0d773a8a873e0664810f90dc4a5707.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c121890>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_78f52008c4a9e93286e10b8230f4a017.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_78f52008c4a9e93286e10b8230f4a017.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c296210>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_0ce67a42f590665b4f60cf694e9d9951.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_0ce67a42f590665b4f60cf694e9d9951.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c067ed510>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_ffa655cc46b00cf25c876e91553e5b3c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_ffa655cc46b00cf25c876e91553e5b3c.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1c78d0>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_2a9cb216844f96d74b95dff045439276.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_2a9cb216844f96d74b95dff045439276.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0621cdd0>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_4b0d773a8a873e0664810f90dc4a5707.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_4b0d773a8a873e0664810f90dc4a5707.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4bc0059bb6be8ba7951b5ee71e5f091e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_8570ca7e60bb34dbcbdd17b7e2bc28af.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_143c5a187d3257f498daae1a9855d136.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_999e8adb185e5401827c1c184591c9fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e7a2e0b35f9f5b737d594b65be9f88dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_c811b7af7a2a7ab2c1ae7bc6c1790fd4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_1c0de57a7f035a4f79a1f5349e386e0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e6e14135df1ac3a926a4a2059e1c610a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_66da6024382f232efa4dec54837029dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065e7c10>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_4bc0059bb6be8ba7951b5ee71e5f091e.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4bc0059bb6be8ba7951b5ee71e5f091e.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0627b850>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_8570ca7e60bb34dbcbdd17b7e2bc28af.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_8570ca7e60bb34dbcbdd17b7e2bc28af.jpg saved to cache
2026-03-28 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_0e2c3b697862bd72a0aababf2420d753.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_7170a94f73d578f629a771ea17db8f75.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06215a10>
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_143c5a187d3257f498daae1a9855d136.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_143c5a187d3257f498daae1a9855d136.jpg saved to cache
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065dd850>
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_999e8adb185e5401827c1c184591c9fc.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_999e8adb185e5401827c1c184591c9fc.jpg saved to cache
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0a3290>
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_e7a2e0b35f9f5b737d594b65be9f88dc.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e7a2e0b35f9f5b737d594b65be9f88dc.jpg saved to cache
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c2944d0>
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F06%252F36067c77454172af648146700123bdee%252Fpa%252FRC92896_c811b7af7a2a7ab2c1ae7bc6c1790fd4.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_c811b7af7a2a7ab2c1ae7bc6c1790fd4.jpg saved to cache
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9a4e72a-932f-5374-8e55-5294198d9e4c
2026-03-28 09:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9a4e72a-932f-5374-8e55-5294198d9e4c, skipping ID generation
2026-03-28 09:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9a4e72a-932f-5374-8e55-5294198d9e4c with scrape type 1
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9a4e72a-932f-5374-8e55-5294198d9e4c sending to next pipeline
2026-03-28 09:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e9a4e72a-932f-5374-8e55-5294198d9e4c, identifier: RC92896
2026-03-28 09:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06545ed0>
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_1c0de57a7f035a4f79a1f5349e386e0b.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_1c0de57a7f035a4f79a1f5349e386e0b.jpg saved to cache
2026-03-28 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066b0a90>
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_e6e14135df1ac3a926a4a2059e1c610a.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e6e14135df1ac3a926a4a2059e1c610a.jpg saved to cache
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896
2026-03-28 09:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896
2026-03-28 09:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896 to the API
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_c811b7af7a2a7ab2c1ae7bc6c1790fd4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'diesel',
 'id': 'e9a4e72a-932f-5374-8e55-5294198d9e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC92896',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 473793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_7c66fc9f19552035a242fdbf008922cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_26a4b6236b198c7111f7e84edacbd688.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_8570ca7e60bb34dbcbdd17b7e2bc28af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_78f52008c4a9e93286e10b8230f4a017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_0ce67a42f590665b4f60cf694e9d9951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_2a9cb216844f96d74b95dff045439276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2173869,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_999e8adb185e5401827c1c184591c9fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_ffa655cc46b00cf25c876e91553e5b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2273187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_c811b7af7a2a7ab2c1ae7bc6c1790fd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a4e72a-932f-5374-8e55-5294198d9e4c/e9a4e72a-932f-5374-8e55-5294198d9e4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/06/36067c77454172af648146700123bdee/pa/RC92896_4b0d773a8a873e0664810f90dc4a5707.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 DRIVe R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2012}
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC92896%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Saving data for RC92896: {'created_time': 1774688817.387607, 'last_price_update_time': 1774688817.387617, 'auction_closing_time': 1774884330.0}
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC92896') HTTP/1.1" 204 0
2026-03-28 09:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066e5a50>
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_66da6024382f232efa4dec54837029dd.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_66da6024382f232efa4dec54837029dd.jpg saved to cache
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_db876a860eadd2985c11f5aa0bfa3249.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f897934b5d77597f9d4d3cf87eddfea6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066e7b10>
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_0e2c3b697862bd72a0aababf2420d753.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_0e2c3b697862bd72a0aababf2420d753.jpg saved to cache
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06765910>
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_7170a94f73d578f629a771ea17db8f75.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_7170a94f73d578f629a771ea17db8f75.jpg saved to cache
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_898d5e386deebe10b4d959d30e1e6b4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_b22bba32ec7b69c15266795d55431de5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066a6d10>
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_db876a860eadd2985c11f5aa0bfa3249.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_db876a860eadd2985c11f5aa0bfa3249.jpg saved to cache
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_8891c10ce1fc3b642e3943c41e9cf2da.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:57 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3440 | hits on page: 40
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06766350>
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_f897934b5d77597f9d4d3cf87eddfea6.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f897934b5d77597f9d4d3cf87eddfea6.jpg saved to cache
2026-03-28 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4484762a4726ed586ef4ac14e7b2ae33.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: UF44040
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF44040%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for UF44040: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD40027%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for JD40027: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: ZS91054
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: TK51874
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: LZ51776
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ51776%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for LZ51776: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: GM25035
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: DA21297
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: XH90607
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH90607%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for XH90607: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: RZ71540
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: AE71384
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: GV81081
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV81081%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for GV81081: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: RL11893
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL11893%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for RL11893: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: TT68141
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW70884%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for WW70884: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT78402%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for KT78402: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: KY18822
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY18822%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for KY18822: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR80545%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for LR80545: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: KC76044
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB75949%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for FB75949: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: JZ08604
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: CX77034
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX77034%27 HTTP/1.1" 200 None
2026-03-28 09:06:57 [auto1.it] INFO: Scrape type for CX77034: 0
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: AL33371
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: SG14661
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-28 09:06:57 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP48054%27 HTTP/1.1" 200 None
2026-03-28 09:06:58 [auto1.it] INFO: Scrape type for VP48054: 0
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: FX33898
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: SD16810
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: CV59379
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV59379%27 HTTP/1.1" 200 None
2026-03-28 09:06:58 [auto1.it] INFO: Scrape type for CV59379: 0
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: AA72149
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA72149%27 HTTP/1.1" 200 None
2026-03-28 09:06:58 [auto1.it] INFO: Scrape type for AA72149: 2
2026-03-28 09:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce366d3d-2bd7-5b11-bc69-83fa7bfe8502 with identifier: AA72149
2026-03-28 09:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce366d3d-2bd7-5b11-bc69-83fa7bfe8502 with scrape type 2
2026-03-28 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce366d3d-2bd7-5b11-bc69-83fa7bfe8502 with scrape type 2
2026-03-28 09:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce366d3d-2bd7-5b11-bc69-83fa7bfe8502, identifier: AA72149
2026-03-28 09:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce366d3d-2bd7-5b11-bc69-83fa7bfe8502 with identifier: AA72149
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 09:06:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce366d3d-2bd7-5b11-bc69-83fa7bfe8502 with identifier: AA72149
2026-03-28 09:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce366d3d-2bd7-5b11-bc69-83fa7bfe8502 with identifier: AA72149 to the API
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:32:09Z',
 'fuel_type': 'diesel',
 'id': 'ce366d3d-2bd7-5b11-bc69-83fa7bfe8502',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA72149',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 171283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.3 M-Jet Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2015}
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA72149%27 HTTP/1.1" 200 None
2026-03-28 09:06:58 [auto1.it] INFO: Saving data for AA72149: {'auction_closing_time': 1774715529.0, 'created_time': 1773664692.437257, 'last_price_update_time': 1774688818.604613}
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AA72149') HTTP/1.1" 204 0
2026-03-28 09:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_51a6423061cbf718744664ed47a92c5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-28 09:06:58 [auto1.it] INFO: Found listing with ID: RL69129
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL69129%27 HTTP/1.1" 200 None
2026-03-28 09:06:58 [auto1.it] INFO: Scrape type for RL69129: 0
2026-03-28 09:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_b42a35bdf15145baed60ada9bd5e0b42.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_052fe9af2dacb133c72e3322a370af89.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c088b10>
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_898d5e386deebe10b4d959d30e1e6b4c.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_898d5e386deebe10b4d959d30e1e6b4c.jpg saved to cache
2026-03-28 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0bc710>
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_b22bba32ec7b69c15266795d55431de5.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_b22bba32ec7b69c15266795d55431de5.jpg saved to cache
2026-03-28 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061d9210>
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F8f%252F148fb99df5d111715e6d2d4b617409a2%252Fpa%252FMB22824_8891c10ce1fc3b642e3943c41e9cf2da.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_8891c10ce1fc3b642e3943c41e9cf2da.jpg saved to cache
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8576450-9316-5576-a88a-8201fbf05cc8
2026-03-28 09:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8576450-9316-5576-a88a-8201fbf05cc8, skipping ID generation
2026-03-28 09:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8576450-9316-5576-a88a-8201fbf05cc8 with scrape type 1
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8576450-9316-5576-a88a-8201fbf05cc8 sending to next pipeline
2026-03-28 09:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8576450-9316-5576-a88a-8201fbf05cc8, identifier: MB22824
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0dc01010>
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_4484762a4726ed586ef4ac14e7b2ae33.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4484762a4726ed586ef4ac14e7b2ae33.jpg saved to cache
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_97bff8f44b5145558318511a2b9cf879.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_841bed0f86ee743770d60348423bd4d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824
2026-03-28 09:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824
2026-03-28 09:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824 to the API
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_8891c10ce1fc3b642e3943c41e9cf2da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'diesel',
 'id': 'e8576450-9316-5576-a88a-8201fbf05cc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB22824',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 251504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2093436,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_8891c10ce1fc3b642e3943c41e9cf2da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2098852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_79eb24ad1010fdabfc40c16ee9773081.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1946593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_898d5e386deebe10b4d959d30e1e6b4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2027300,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_b22bba32ec7b69c15266795d55431de5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_552c5085e0186f4f6def93a94ed8a5d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1947538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_66da6024382f232efa4dec54837029dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1987892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e6e14135df1ac3a926a4a2059e1c610a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2130155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_143c5a187d3257f498daae1a9855d136.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_1c0de57a7f035a4f79a1f5349e386e0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8576450-9316-5576-a88a-8201fbf05cc8/e8576450-9316-5576-a88a-8201fbf05cc8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2434297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8f/148fb99df5d111715e6d2d4b617409a2/pa/MB22824_e7a2e0b35f9f5b737d594b65be9f88dc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-06-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2007}
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB22824%27 HTTP/1.1" 200 None
2026-03-28 09:06:59 [auto1.it] INFO: Saving data for MB22824: {'created_time': 1774688819.633603, 'last_price_update_time': 1774688819.633614, 'auction_closing_time': 1774885663.0}
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB22824') HTTP/1.1" 204 0
2026-03-28 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ba7d22fbdc6180baa962f55b0b32892.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f37d2d99ad30e438b40d50aa22a95724.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065de090>
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_51a6423061cbf718744664ed47a92c5d.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_51a6423061cbf718744664ed47a92c5d.jpg saved to cache
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c070e50>
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_b42a35bdf15145baed60ada9bd5e0b42.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_b42a35bdf15145baed60ada9bd5e0b42.jpg saved to cache
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061d5190>
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_052fe9af2dacb133c72e3322a370af89.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_052fe9af2dacb133c72e3322a370af89.jpg saved to cache
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0d35d0>
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_97bff8f44b5145558318511a2b9cf879.jpg') HTTP/1.1" 204 0
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_97bff8f44b5145558318511a2b9cf879.jpg saved to cache
2026-03-28 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061d7a90>
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F6e%252Fea6e24be6a828bc1192570b4934f9e2b%252Fpa%252FNW35507_841bed0f86ee743770d60348423bd4d6.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_841bed0f86ee743770d60348423bd4d6.jpg saved to cache
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b19c3575-20ed-5a1e-a32e-504237c9db68
2026-03-28 09:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b19c3575-20ed-5a1e-a32e-504237c9db68, skipping ID generation
2026-03-28 09:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c3575-20ed-5a1e-a32e-504237c9db68 with scrape type 1
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b19c3575-20ed-5a1e-a32e-504237c9db68 sending to next pipeline
2026-03-28 09:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b19c3575-20ed-5a1e-a32e-504237c9db68, identifier: NW35507
2026-03-28 09:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507
2026-03-28 09:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507
2026-03-28 09:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507 to the API
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_841bed0f86ee743770d60348423bd4d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:18:41Z',
 'fuel_type': 'petrol',
 'id': 'b19c3575-20ed-5a1e-a32e-504237c9db68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW35507',
 'listing': 'auction',
 'location': 'IT, Corsico',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 20282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4484762a4726ed586ef4ac14e7b2ae33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_9705b75aa0d438c0cc5e9f08093ecbbe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_cea3d51482e8fbccd70e011ff8e0b0e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_7170a94f73d578f629a771ea17db8f75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_2a86d26cfa6d982505d189904861ddef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_97bff8f44b5145558318511a2b9cf879.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_841bed0f86ee743770d60348423bd4d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_f4482ea5c113dba5080f23a283b3078d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_0e2c3b697862bd72a0aababf2420d753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c3575-20ed-5a1e-a32e-504237c9db68/b19c3575-20ed-5a1e-a32e-504237c9db68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/6e/ea6e24be6a828bc1192570b4934f9e2b/pa/NW35507_4bc0059bb6be8ba7951b5ee71e5f091e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW35507%27 HTTP/1.1" 200 None
2026-03-28 09:07:00 [auto1.it] INFO: Saving data for NW35507: {'created_time': 1774688820.546012, 'last_price_update_time': 1774688820.546023, 'auction_closing_time': 1774883921.0}
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NW35507') HTTP/1.1" 204 0
2026-03-28 09:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_7ec4d9bae2fbc830321e394990205a98.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_040290b34bd7d82efaeff1966c510013.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_63feadb37474d5a8973afcfc12063b4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065b8150>
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_3ba7d22fbdc6180baa962f55b0b32892.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ba7d22fbdc6180baa962f55b0b32892.jpg saved to cache
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06517350>
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_f37d2d99ad30e438b40d50aa22a95724.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f37d2d99ad30e438b40d50aa22a95724.jpg saved to cache
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c1b7cd0>
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_7ec4d9bae2fbc830321e394990205a98.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_7ec4d9bae2fbc830321e394990205a98.jpg saved to cache
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06590410>
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F0e%252Fc40eaabf833587b77add42b26e67e589%252Fpa%252FMM70792_040290b34bd7d82efaeff1966c510013.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_040290b34bd7d82efaeff1966c510013.jpg saved to cache
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8
2026-03-28 09:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8, skipping ID generation
2026-03-28 09:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with scrape type 1
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 sending to next pipeline
2026-03-28 09:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8, identifier: MM70792
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db2a610>
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_63feadb37474d5a8973afcfc12063b4a.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_63feadb37474d5a8973afcfc12063b4a.jpg saved to cache
2026-03-28 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792
2026-03-28 09:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792
2026-03-28 09:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792 to the API
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_040290b34bd7d82efaeff1966c510013.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'diesel',
 'id': 'a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM70792',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 183311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_1a39ee8918e9c13c0f9b17af5737136e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_040290b34bd7d82efaeff1966c510013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_5e5ecfb565aee3110ae3e42c90a2a95f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_bef03e02222ce548d8da891cbbd1df56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8/a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/0e/c40eaabf833587b77add42b26e67e589/pa/MM70792_d46ee26ad1707f63bb24b7404171159e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70792%27 HTTP/1.1" 200 None
2026-03-28 09:07:01 [auto1.it] INFO: Saving data for MM70792: {'created_time': 1774688821.279384, 'last_price_update_time': 1774688821.279395, 'auction_closing_time': 1774886218.0}
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MM70792') HTTP/1.1" 204 0
2026-03-28 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_046424d888a2b693f4cb74b76c5b3bf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ee18785d2eddd07dc9a2c1a9c8fe804.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_1666c7311b4150c4c94879bf33de858e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_aafc516039e9b0d6fc98475f2cee3a10.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_917a6effe5863a782096d59ef1299adc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_301c8ad909c2f1f226a9d9cdbad63228.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5e70f25fdd7689ce7447fd810906213e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065ba850>
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F6b%252F3e6bfb1cf385943eb6207ff40c8a1024%252Fpa%252FWK68121_046424d888a2b693f4cb74b76c5b3bf7.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_046424d888a2b693f4cb74b76c5b3bf7.jpg saved to cache
2026-03-28 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8
2026-03-28 09:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ebfb8d2-8b5e-51d5-a046-83091f641af8, skipping ID generation
2026-03-28 09:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with scrape type 1
2026-03-28 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8 sending to next pipeline
2026-03-28 09:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ebfb8d2-8b5e-51d5-a046-83091f641af8, identifier: WK68121
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0db28750>
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7d%252F7f7dc092dcd3eb81d00019515f5dc546%252Fpa%252FCR16346_3ee18785d2eddd07dc9a2c1a9c8fe804.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ee18785d2eddd07dc9a2c1a9c8fe804.jpg saved to cache
2026-03-28 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26
2026-03-28 09:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26, skipping ID generation
2026-03-28 09:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with scrape type 1
2026-03-28 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 sending to next pipeline
2026-03-28 09:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26, identifier: CR16346
2026-03-28 09:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121
2026-03-28 09:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121
2026-03-28 09:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121 to the API
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_046424d888a2b693f4cb74b76c5b3bf7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'petrol',
 'id': '8ebfb8d2-8b5e-51d5-a046-83091f641af8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK68121',
 'listing': 'auction',
 'location': 'IT, Segrate',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 81885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_046424d888a2b693f4cb74b76c5b3bf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_1448ed284bff431897c2137a4c9b253a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_8f59746b90eac3cd12913034f24bb201.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0219b25e61b45715b39f3f77c9cf483c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0207396e8113bf03a035a922517ec97d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_2126f2f82e7c37c2ae0ade2b2b73baab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_bfa962a70a3832ffa3e4e9f3d66fa920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_052fe9af2dacb133c72e3322a370af89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_d2283278ba56a87ae8e0c028c875dc70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ebfb8d2-8b5e-51d5-a046-83091f641af8/8ebfb8d2-8b5e-51d5-a046-83091f641af8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/6b/3e6bfb1cf385943eb6207ff40c8a1024/pa/WK68121_0e680148b2a88040c4276f881b379139.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK68121%27 HTTP/1.1" 200 None
2026-03-28 09:07:02 [auto1.it] INFO: Saving data for WK68121: {'created_time': 1774688822.045862, 'last_price_update_time': 1774688822.045872, 'auction_closing_time': 1774885663.0}
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WK68121') HTTP/1.1" 204 0
2026-03-28 09:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346
2026-03-28 09:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346
2026-03-28 09:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346 to the API
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ee18785d2eddd07dc9a2c1a9c8fe804.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:42:01Z',
 'fuel_type': 'diesel',
 'id': 'b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR16346',
 'listing': 'auction',
 'location': 'IT, Cinisello Balsamo',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 112504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ee18785d2eddd07dc9a2c1a9c8fe804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_63feadb37474d5a8973afcfc12063b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_c032bb405ff411908468de7a9f6e4e61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f37d2d99ad30e438b40d50aa22a95724.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_3ba7d22fbdc6180baa962f55b0b32892.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_70606990921e2c28727e9f010bbc9e04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_d8da00f52415af80cea5c14a928521b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_51a6423061cbf718744664ed47a92c5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_f897934b5d77597f9d4d3cf87eddfea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26/b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7d/7f7dc092dcd3eb81d00019515f5dc546/pa/CR16346_db876a860eadd2985c11f5aa0bfa3249.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR16346%27 HTTP/1.1" 200 None
2026-03-28 09:07:02 [auto1.it] INFO: Saving data for CR16346: {'created_time': 1774688822.412675, 'last_price_update_time': 1774688822.412685, 'auction_closing_time': 1774885321.0}
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR16346') HTTP/1.1" 204 0
2026-03-28 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC74563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD21393> (referer: https://www.auto1.com/v1/car-details-view/PD21393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR63683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA37529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061deed0>
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F9515259fac1f24a06ab7d2af7a7ba0c3%252Fpa%252FDF91853_1666c7311b4150c4c94879bf33de858e.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_1666c7311b4150c4c94879bf33de858e.jpg saved to cache
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e
2026-03-28 09:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e, skipping ID generation
2026-03-28 09:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with scrape type 1
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e sending to next pipeline
2026-03-28 09:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e, identifier: DF91853
2026-03-28 09:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0660dd50>
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_aafc516039e9b0d6fc98475f2cee3a10.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_aafc516039e9b0d6fc98475f2cee3a10.jpg saved to cache
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c31b790>
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_917a6effe5863a782096d59ef1299adc.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_917a6effe5863a782096d59ef1299adc.jpg saved to cache
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06716590>
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_301c8ad909c2f1f226a9d9cdbad63228.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_301c8ad909c2f1f226a9d9cdbad63228.jpg saved to cache
2026-03-28 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066b3510>
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fc4%252F1cc4ce6cde65035cc0502f2f6580a530%252Fpa%252FDR04246_5e70f25fdd7689ce7447fd810906213e.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5e70f25fdd7689ce7447fd810906213e.jpg saved to cache
2026-03-28 09:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68
2026-03-28 09:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa50a3f9-1a16-5cf7-8d6b-af01d61dea68, skipping ID generation
2026-03-28 09:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68 with scrape type 1
2026-03-28 09:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa50a3f9-1a16-5cf7-8d6b-af01d61dea68 sending to next pipeline
2026-03-28 09:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa50a3f9-1a16-5cf7-8d6b-af01d61dea68, identifier: DR04246
2026-03-28 09:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853
2026-03-28 09:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853
2026-03-28 09:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853 to the API
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_1666c7311b4150c4c94879bf33de858e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:32:40Z',
 'fuel_type': 'petrol',
 'id': 'fd66edc9-6f36-54da-94f3-f4d6f1fbd23e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF91853',
 'listing': 'auction',
 'location': 'IT, Imola',
 'make': 'Lancia',
 'model': 'Musa',
 'odometer': 201063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_1666c7311b4150c4c94879bf33de858e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_85461e1fa87fd993f467c2d82c5367db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_e951b159ceb85c7bba015c5bdc2424e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_7f498683fd01483e8b15edd0eadd6380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd66edc9-6f36-54da-94f3-f4d6f1fbd23e/fd66edc9-6f36-54da-94f3-f4d6f1fbd23e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/9515259fac1f24a06ab7d2af7a7ba0c3/pa/DF91853_a8b9fdebfe3827619d27c88c4563bc8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Musa 1.4 E-Collection',
 'transmission': 'manual',
 'trim': 'E-Collection',
 'year': 2010}
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF91853%27 HTTP/1.1" 200 None
2026-03-28 09:07:03 [auto1.it] INFO: Saving data for DF91853: {'created_time': 1774688823.494932, 'last_price_update_time': 1774688823.494943, 'auction_closing_time': 1774884760.0}
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF91853') HTTP/1.1" 204 0
2026-03-28 09:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa50a3f9-1a16-5cf7-8d6b-af01d61dea68 with identifier: DR04246
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 09:07:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa50a3f9-1a16-5cf7-8d6b-af01d61dea68 with identifier: DR04246
2026-03-28 09:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa50a3f9-1a16-5cf7-8d6b-af01d61dea68 with identifier: DR04246 to the API
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5e70f25fdd7689ce7447fd810906213e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 283,
 'expiration_date': '2026-03-30T15:31:58Z',
 'fuel_type': 'electro',
 'id': 'aa50a3f9-1a16-5cf7-8d6b-af01d61dea68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR04246',
 'listing': 'auction',
 'location': 'IT, Varese',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 12990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419785,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_36e8dd0901d45b27cb0a567591722453.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_7ec4d9bae2fbc830321e394990205a98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5e70f25fdd7689ce7447fd810906213e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421093,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_301c8ad909c2f1f226a9d9cdbad63228.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2329751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_5b2d7ce47d3a6e410666d0fe2fca72ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_917a6effe5863a782096d59ef1299adc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2241383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_aafc516039e9b0d6fc98475f2cee3a10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_d11a6f1bdfe6cdcfba84d0eb66af634b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2352518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_b42a35bdf15145baed60ada9bd5e0b42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa50a3f9-1a16-5cf7-8d6b-af01d61dea68/aa50a3f9-1a16-5cf7-8d6b-af01d61dea68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/c4/1cc4ce6cde65035cc0502f2f6580a530/pa/DR04246_9d46392eec4cdd0666f69028874e894d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR04246%27 HTTP/1.1" 200 None
2026-03-28 09:07:03 [auto1.it] INFO: Saving data for DR04246: {'created_time': 1774688823.951304, 'last_price_update_time': 1774688823.951314, 'auction_closing_time': 1774884718.0}
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DR04246') HTTP/1.1" 204 0
2026-03-28 09:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393
2026-03-28 09:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with scrape type 1
2026-03-28 09:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_9b97f3b349af59cb1c802caf7d17fa0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_9b97f3b349af59cb1c802caf7d17fa0d.jpg not downloaded yet
2026-03-28 09:07:03 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_ead5c773b51087c629b5387051705e46.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_ead5c773b51087c629b5387051705e46.jpg not downloaded yet
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: AN76341
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: VW08659
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: BE85602
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL22636%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for AL22636: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74830%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for WA74830: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: YM41293
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: JK70012
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: FF54674
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV08764%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for FV08764: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: KM79113
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM79113%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for KM79113: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: RA21109
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24235%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for SC24235: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: PC98849
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT67830%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for UT67830: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: KS82343
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: YB28185
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: UJ22740
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ22740%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for UJ22740: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: JV82162
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: UX20076
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: SN27991
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN27991%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for SN27991: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: MD06085
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD06085%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for MD06085: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: SS79463
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS79463%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for SS79463: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC91027%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for MC91027: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: ZT24838
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT24838%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for ZT24838: 2
2026-03-28 09:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039cc00e-0dea-5b75-accc-0fec7d962f66 with identifier: ZT24838
2026-03-28 09:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039cc00e-0dea-5b75-accc-0fec7d962f66 with scrape type 2
2026-03-28 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039cc00e-0dea-5b75-accc-0fec7d962f66 with scrape type 2
2026-03-28 09:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 039cc00e-0dea-5b75-accc-0fec7d962f66, identifier: ZT24838
2026-03-28 09:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 039cc00e-0dea-5b75-accc-0fec7d962f66 with identifier: ZT24838
2026-03-28 09:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 039cc00e-0dea-5b75-accc-0fec7d962f66 with identifier: ZT24838
2026-03-28 09:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 039cc00e-0dea-5b75-accc-0fec7d962f66 with identifier: ZT24838 to the API
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:13Z',
 'fuel_type': 'diesel',
 'id': '039cc00e-0dea-5b75-accc-0fec7d962f66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT24838',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 324979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2017}
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT24838%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Saving data for ZT24838: {'auction_closing_time': 1774715953.0, 'created_time': 1772784124.393773, 'last_price_update_time': 1774688824.648214}
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT24838') HTTP/1.1" 204 0
2026-03-28 09:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_f955568dd0bdb20569ea0962dc78530c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_f955568dd0bdb20569ea0962dc78530c.jpg not downloaded yet
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: JK02005
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: RB72441
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: EC66438
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC66438%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for EC66438: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: VK05865
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK05865%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for VK05865: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: WR22265
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN16063%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for UN16063: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: YA33323
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA33323%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for YA33323: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: EM46556
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM46556%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for EM46556: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP55584%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for CP55584: 0
2026-03-28 09:07:04 [auto1.it] INFO: Found listing with ID: VT45573
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT45573%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [auto1.it] INFO: Scrape type for VT45573: 0
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_5a3f87acbe93ac633c1857f22474faa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_5a3f87acbe93ac633c1857f22474faa3.jpg not downloaded yet
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_8f025a758f7299de5a690727822d4e32.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_8f025a758f7299de5a690727822d4e32.jpg not downloaded yet
2026-03-28 09:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_9b97f3b349af59cb1c802caf7d17fa0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_f955568dd0bdb20569ea0962dc78530c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_5a3f87acbe93ac633c1857f22474faa3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066a5850>
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_9b97f3b349af59cb1c802caf7d17fa0d.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_9b97f3b349af59cb1c802caf7d17fa0d.jpg saved to cache
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0ec790>
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_f955568dd0bdb20569ea0962dc78530c.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_f955568dd0bdb20569ea0962dc78530c.jpg saved to cache
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d87ae50>
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_5a3f87acbe93ac633c1857f22474faa3.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_5a3f87acbe93ac633c1857f22474faa3.jpg saved to cache
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643
2026-03-28 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_8f025a758f7299de5a690727822d4e32.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:05 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 77 pages/min), scraped 93 items (at 64 items/min)
2026-03-28 09:07:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 208MiB
2026-03-28 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_ead5c773b51087c629b5387051705e46.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0663ea90>
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_8f025a758f7299de5a690727822d4e32.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_8f025a758f7299de5a690727822d4e32.jpg saved to cache
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c08a310>
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd7226ef169b040206b72dbea866a8%252Fpa%252FPD21393_ead5c773b51087c629b5387051705e46.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_ead5c773b51087c629b5387051705e46.jpg saved to cache
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643
2026-03-28 09:07:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643, skipping ID generation
2026-03-28 09:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with scrape type 1
2026-03-28 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 sending to next pipeline
2026-03-28 09:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643, identifier: PD21393
2026-03-28 09:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393
2026-03-28 09:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393
2026-03-28 09:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393 to the API
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_ead5c773b51087c629b5387051705e46.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:28:11Z',
 'fuel_type': 'petrol',
 'id': '3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD21393',
 'listing': 'auction',
 'location': 'IT, Cesena',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 159572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_9b97f3b349af59cb1c802caf7d17fa0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_ead5c773b51087c629b5387051705e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_f955568dd0bdb20569ea0962dc78530c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_5a3f87acbe93ac633c1857f22474faa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643/3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd7226ef169b040206b72dbea866a8/pa/PD21393_8f025a758f7299de5a690727822d4e32.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Argento',
 'transmission': 'manual',
 'trim': 'Argento',
 'year': 2006}
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD21393%27 HTTP/1.1" 200 None
2026-03-28 09:07:05 [auto1.it] INFO: Saving data for PD21393: {'created_time': 1774688825.870316, 'last_price_update_time': 1774688825.870327, 'auction_closing_time': 1774884491.0}
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD21393') HTTP/1.1" 204 0
2026-03-28 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC74563> (referer: https://www.auto1.com/v1/car-details-view/KC74563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR63683> (referer: https://www.auto1.com/v1/car-details-view/PR63683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:06 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU13564%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for MU13564: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: UD16121
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: EC11217
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: XV48493
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV48493%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for XV48493: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: MD24560
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD24560%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for MD24560: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: XT99009
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: EV86886
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV86886%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for EV86886: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: UR82213
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR82213%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for UR82213: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: TP47209
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: ZA41096
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA41096%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for ZA41096: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: US82962
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: NU85167
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: ZY01206
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: UB37048
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB37048%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for UB37048: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: CF64613
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF64613%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for CF64613: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: TY88258
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: YJ50893
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: FE47038
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE47038%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for FE47038: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: KS22077
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: DF42312
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: XZ56129
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ56129%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for XZ56129: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: EU76954
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: YU54798
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: RK45899
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: KM82179
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM82179%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for KM82179: 2
2026-03-28 09:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a03bda-4dc9-5b08-9c01-02f54c9bca1f with identifier: KM82179
2026-03-28 09:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a03bda-4dc9-5b08-9c01-02f54c9bca1f with scrape type 2
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a03bda-4dc9-5b08-9c01-02f54c9bca1f with scrape type 2
2026-03-28 09:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5a03bda-4dc9-5b08-9c01-02f54c9bca1f, identifier: KM82179
2026-03-28 09:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5a03bda-4dc9-5b08-9c01-02f54c9bca1f with identifier: KM82179
2026-03-28 09:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5a03bda-4dc9-5b08-9c01-02f54c9bca1f with identifier: KM82179
2026-03-28 09:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5a03bda-4dc9-5b08-9c01-02f54c9bca1f with identifier: KM82179 to the API
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:15:54Z',
 'fuel_type': 'diesel',
 'id': 'e5a03bda-4dc9-5b08-9c01-02f54c9bca1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM82179',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 212341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-10',
 'seller_name': None,
 'title': 'Citroen DS5 2.0 HDi SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2012}
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM82179%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Saving data for KM82179: {'auction_closing_time': 1774714554.0, 'created_time': 1773231152.742745, 'last_price_update_time': 1774688826.677185}
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM82179') HTTP/1.1" 204 0
2026-03-28 09:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563
2026-03-28 09:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc with scrape type 1
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_02b3aac69203bdf055bc63c9d78a9a80.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_02b3aac69203bdf055bc63c9d78a9a80.jpg not downloaded yet
2026-03-28 09:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683
2026-03-28 09:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b48a4432-4359-50d0-9829-431557c92abe with scrape type 1
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_75c05ce030c60e2961a30447160a3b52.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_75c05ce030c60e2961a30447160a3b52.jpg not downloaded yet
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: WA14030
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA14030%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for WA14030: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: FJ36281
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ36281%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for FJ36281: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: SC05830
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05830%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for SC05830: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: DX52921
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX52921%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for DX52921: 0
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: TG05681
2026-03-28 09:07:06 [auto1.it] INFO: Found listing with ID: ZJ11157
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ11157%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [auto1.it] INFO: Scrape type for ZJ11157: 0
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_91ca05e9f0e42447c76c99313ae8fc16.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_91ca05e9f0e42447c76c99313ae8fc16.jpg not downloaded yet
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_54aaf7019bee1dc5e0b06d18df93ce65.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_54aaf7019bee1dc5e0b06d18df93ce65.jpg not downloaded yet
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_1f1e1a90a14acf9673c15fc3ac232e51.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_1f1e1a90a14acf9673c15fc3ac232e51.jpg not downloaded yet
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_60bc4e57713afc34860c3d8c49d13429.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_60bc4e57713afc34860c3d8c49d13429.jpg not downloaded yet
2026-03-28 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_ba8177c308cad90bbd8c07851391c0b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_ba8177c308cad90bbd8c07851391c0b9.jpg not downloaded yet
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_e7114680355bfb6047249075a7cb1b4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_e7114680355bfb6047249075a7cb1b4f.jpg not downloaded yet
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_de132e4830f45386c4515c88ed4c37a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_de132e4830f45386c4515c88ed4c37a1.jpg not downloaded yet
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_61da4f0b2c76945c3fcbabb648f46018.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_61da4f0b2c76945c3fcbabb648f46018.jpg not downloaded yet
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_75c05ce030c60e2961a30447160a3b52.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_6c473646695d887675f822eb625d3789.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_6c473646695d887675f822eb625d3789.jpg not downloaded yet
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_8415c2483302068d2d72f20f125d66a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_8415c2483302068d2d72f20f125d66a5.jpg not downloaded yet
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_5234236c496e4142331a00ad36c989a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_5234236c496e4142331a00ad36c989a8.jpg not downloaded yet
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_02b3aac69203bdf055bc63c9d78a9a80.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_55eca2eaaca49c54ec6ac374849361a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_55eca2eaaca49c54ec6ac374849361a0.jpg not downloaded yet
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_1f1e1a90a14acf9673c15fc3ac232e51.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_ded07f19e9577c48ee6798c3248bb8bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_ded07f19e9577c48ee6798c3248bb8bd.jpg not downloaded yet
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c07ad10>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_75c05ce030c60e2961a30447160a3b52.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_75c05ce030c60e2961a30447160a3b52.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_91ca05e9f0e42447c76c99313ae8fc16.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_ba8177c308cad90bbd8c07851391c0b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_54aaf7019bee1dc5e0b06d18df93ce65.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0637d0>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_02b3aac69203bdf055bc63c9d78a9a80.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_02b3aac69203bdf055bc63c9d78a9a80.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_e7114680355bfb6047249075a7cb1b4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c063d10>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_1f1e1a90a14acf9673c15fc3ac232e51.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_1f1e1a90a14acf9673c15fc3ac232e51.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0b1150>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_91ca05e9f0e42447c76c99313ae8fc16.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_91ca05e9f0e42447c76c99313ae8fc16.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_de132e4830f45386c4515c88ed4c37a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_61da4f0b2c76945c3fcbabb648f46018.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d8b0c10>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_ba8177c308cad90bbd8c07851391c0b9.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_ba8177c308cad90bbd8c07851391c0b9.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_8415c2483302068d2d72f20f125d66a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c1afb66d0>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_54aaf7019bee1dc5e0b06d18df93ce65.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_54aaf7019bee1dc5e0b06d18df93ce65.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_5234236c496e4142331a00ad36c989a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d859b10>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_e7114680355bfb6047249075a7cb1b4f.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_e7114680355bfb6047249075a7cb1b4f.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_55eca2eaaca49c54ec6ac374849361a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c062050>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F72%252F4d729c1f5c2cbee486886841ce14d2c1%252Fpa%252FKC74563_de132e4830f45386c4515c88ed4c37a1.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_de132e4830f45386c4515c88ed4c37a1.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc
2026-03-28 09:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2fa789e-d778-5c8f-ad71-1e20f2a899dc, skipping ID generation
2026-03-28 09:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc with scrape type 1
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc sending to next pipeline
2026-03-28 09:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2fa789e-d778-5c8f-ad71-1e20f2a899dc, identifier: KC74563
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c121dd0>
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_61da4f0b2c76945c3fcbabb648f46018.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_61da4f0b2c76945c3fcbabb648f46018.jpg saved to cache
2026-03-28 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_ded07f19e9577c48ee6798c3248bb8bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563
2026-03-28 09:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563
2026-03-28 09:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563 to the API
2026-03-28 09:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_de132e4830f45386c4515c88ed4c37a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.7L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'diesel',
 'id': 'a2fa789e-d778-5c8f-ad71-1e20f2a899dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC74563',
 'listing': 'auction',
 'location': 'IT, Bergamo',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 142655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_02b3aac69203bdf055bc63c9d78a9a80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_91ca05e9f0e42447c76c99313ae8fc16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_1f1e1a90a14acf9673c15fc3ac232e51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_ba8177c308cad90bbd8c07851391c0b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2fa789e-d778-5c8f-ad71-1e20f2a899dc/a2fa789e-d778-5c8f-ad71-1e20f2a899dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/72/4d729c1f5c2cbee486886841ce14d2c1/pa/KC74563_de132e4830f45386c4515c88ed4c37a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra GTC 1.7 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC74563%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Saving data for KC74563: {'created_time': 1774688828.138102, 'last_price_update_time': 1774688828.138112, 'auction_closing_time': 1774883122.0}
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC74563') HTTP/1.1" 204 0
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c072c50>
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_8415c2483302068d2d72f20f125d66a5.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_8415c2483302068d2d72f20f125d66a5.jpg saved to cache
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0edf50>
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_5234236c496e4142331a00ad36c989a8.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_5234236c496e4142331a00ad36c989a8.jpg saved to cache
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c06767f10>
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_55eca2eaaca49c54ec6ac374849361a0.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_55eca2eaaca49c54ec6ac374849361a0.jpg saved to cache
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c1c338890>
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_ded07f19e9577c48ee6798c3248bb8bd.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_ded07f19e9577c48ee6798c3248bb8bd.jpg saved to cache
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_60bc4e57713afc34860c3d8c49d13429.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_6c473646695d887675f822eb625d3789.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:08 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG85862%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Scrape type for FG85862: 0
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: SH24960
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH24960%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Scrape type for SH24960: 2
2026-03-28 09:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58dd544a-9231-527a-894d-76f1dd14f5b4 with identifier: SH24960
2026-03-28 09:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58dd544a-9231-527a-894d-76f1dd14f5b4 with scrape type 2
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58dd544a-9231-527a-894d-76f1dd14f5b4 with scrape type 2
2026-03-28 09:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58dd544a-9231-527a-894d-76f1dd14f5b4, identifier: SH24960
2026-03-28 09:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58dd544a-9231-527a-894d-76f1dd14f5b4 with identifier: SH24960
2026-03-28 09:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58dd544a-9231-527a-894d-76f1dd14f5b4 with identifier: SH24960
2026-03-28 09:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58dd544a-9231-527a-894d-76f1dd14f5b4 with identifier: SH24960 to the API
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:01Z',
 'fuel_type': 'diesel',
 'id': '58dd544a-9231-527a-894d-76f1dd14f5b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH24960',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 128312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-21',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exceed 4WD',
 'transmission': 'automatic',
 'trim': 'Exceed 4WD',
 'year': 2015}
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH24960%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Saving data for SH24960: {'auction_closing_time': 1774716841.0, 'created_time': 1773137812.919877, 'last_price_update_time': 1774688828.829625}
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH24960') HTTP/1.1" 204 0
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: WR20789
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: TK53428
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: ZM39630
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM39630%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Scrape type for ZM39630: 0
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: SK44334
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: DP62662
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: XD24823
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD24823%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Scrape type for XD24823: 0
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: NB02021
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: VC74933
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: UT52795
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT52795%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Scrape type for UT52795: 0
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: MX71384
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX71384%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Scrape type for MX71384: 0
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: EB41992
2026-03-28 09:07:08 [auto1.it] INFO: Found listing with ID: ZF01479
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01479%27 HTTP/1.1" 200 None
2026-03-28 09:07:08 [auto1.it] INFO: Scrape type for ZF01479: 2
2026-03-28 09:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479
2026-03-28 09:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7f1382d-8621-5828-9bc6-fbc65e61d102 with scrape type 2
2026-03-28 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7f1382d-8621-5828-9bc6-fbc65e61d102 with scrape type 2
2026-03-28 09:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7f1382d-8621-5828-9bc6-fbc65e61d102, identifier: ZF01479
2026-03-28 09:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479
2026-03-28 09:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479
2026-03-28 09:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479 to the API
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:59Z',
 'fuel_type': 'diesel',
 'id': 'f7f1382d-8621-5828-9bc6-fbc65e61d102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF01479',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 89998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01479%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Saving data for ZF01479: {'auction_closing_time': 1774716299.0, 'created_time': 1773695183.488112, 'last_price_update_time': 1774688829.339321}
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF01479') HTTP/1.1" 204 0
2026-03-28 09:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065ccc50>
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_60bc4e57713afc34860c3d8c49d13429.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_60bc4e57713afc34860c3d8c49d13429.jpg saved to cache
2026-03-28 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c27d850>
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F39%252F55392d6a7a0b21802083583a49463ed1%252Fpa%252FPR63683_6c473646695d887675f822eb625d3789.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_6c473646695d887675f822eb625d3789.jpg saved to cache
2026-03-28 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b48a4432-4359-50d0-9829-431557c92abe
2026-03-28 09:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b48a4432-4359-50d0-9829-431557c92abe, skipping ID generation
2026-03-28 09:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b48a4432-4359-50d0-9829-431557c92abe with scrape type 1
2026-03-28 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b48a4432-4359-50d0-9829-431557c92abe sending to next pipeline
2026-03-28 09:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b48a4432-4359-50d0-9829-431557c92abe, identifier: PR63683
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT94493%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for CT94493: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: BS51992
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS51992%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for BS51992: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: WJ94048
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: WE26685
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE26685%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for WE26685: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU40150%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for NU40150: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: TL80990
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL80990%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for TL80990: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: YL27459
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL27459%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for YL27459: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: AG12486
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: VS63609
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: UH61240
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: DM21687
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL42866%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for ZL42866: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA38395%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for YA38395: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: TK21240
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP75887%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for VP75887: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC55633%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for RC55633: 0
2026-03-28 09:07:09 [auto1.it] INFO: Found listing with ID: DB38288
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB38288%27 HTTP/1.1" 200 None
2026-03-28 09:07:09 [auto1.it] INFO: Scrape type for DB38288: 2
2026-03-28 09:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028bba75-f8c8-5c2a-9e72-7c4287fba2f4 with identifier: DB38288
2026-03-28 09:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028bba75-f8c8-5c2a-9e72-7c4287fba2f4 with scrape type 2
2026-03-28 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028bba75-f8c8-5c2a-9e72-7c4287fba2f4 with scrape type 2
2026-03-28 09:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 028bba75-f8c8-5c2a-9e72-7c4287fba2f4, identifier: DB38288
2026-03-28 09:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683
2026-03-28 09:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683
2026-03-28 09:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683 to the API
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_6c473646695d887675f822eb625d3789.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:27:14Z',
 'fuel_type': 'petrol',
 'id': 'b48a4432-4359-50d0-9829-431557c92abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR63683',
 'listing': 'auction',
 'location': 'IT, Gadesco-Pieve Delmona',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 111514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_75c05ce030c60e2961a30447160a3b52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_54aaf7019bee1dc5e0b06d18df93ce65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2834932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_60bc4e57713afc34860c3d8c49d13429.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_e7114680355bfb6047249075a7cb1b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_61da4f0b2c76945c3fcbabb648f46018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_6c473646695d887675f822eb625d3789.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_8415c2483302068d2d72f20f125d66a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_5234236c496e4142331a00ad36c989a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_55eca2eaaca49c54ec6ac374849361a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b48a4432-4359-50d0-9829-431557c92abe/b48a4432-4359-50d0-9829-431557c92abe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/39/55392d6a7a0b21802083583a49463ed1/pa/PR63683_ded07f19e9577c48ee6798c3248bb8bd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR63683%27 HTTP/1.1" 200 None
2026-03-28 09:07:10 [auto1.it] INFO: Saving data for PR63683: {'created_time': 1774688830.436714, 'last_price_update_time': 1774688830.436725, 'auction_closing_time': 1774884434.0}
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR63683') HTTP/1.1" 204 0
2026-03-28 09:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 028bba75-f8c8-5c2a-9e72-7c4287fba2f4 with identifier: DB38288
2026-03-28 09:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 028bba75-f8c8-5c2a-9e72-7c4287fba2f4 with identifier: DB38288
2026-03-28 09:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 028bba75-f8c8-5c2a-9e72-7c4287fba2f4 with identifier: DB38288 to the API
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:06:18Z',
 'fuel_type': 'petrol',
 'id': '028bba75-f8c8-5c2a-9e72-7c4287fba2f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB38288',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 71492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2020}
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB38288%27 HTTP/1.1" 200 None
2026-03-28 09:07:10 [auto1.it] INFO: Saving data for DB38288: {'auction_closing_time': 1774713978.0, 'created_time': 1772655326.26071, 'last_price_update_time': 1774688830.881731}
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DB38288') HTTP/1.1" 204 0
2026-03-28 09:07:10 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF04289%27 HTTP/1.1" 200 None
2026-03-28 09:07:10 [auto1.it] INFO: Scrape type for ZF04289: 0
2026-03-28 09:07:10 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP33035%27 HTTP/1.1" 200 None
2026-03-28 09:07:10 [auto1.it] INFO: Scrape type for NP33035: 0
2026-03-28 09:07:10 [auto1.it] INFO: Found listing with ID: PA22608
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA22608%27 HTTP/1.1" 200 None
2026-03-28 09:07:10 [auto1.it] INFO: Scrape type for PA22608: 0
2026-03-28 09:07:10 [auto1.it] INFO: Found listing with ID: FH02566
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH02566%27 HTTP/1.1" 200 None
2026-03-28 09:07:10 [auto1.it] INFO: Scrape type for FH02566: 0
2026-03-28 09:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:12 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: XZ64969
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ64969%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for XZ64969: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: LJ35523
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ35523%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for LJ35523: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: HH64433
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: GT36426
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: GB77184
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB77184%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for GB77184: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC91970%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for FC91970: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: RK33520
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK33520%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for RK33520: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: RU39980
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: NG82914
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG82914%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for NG82914: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30560%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for JD30560: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC51604%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for LC51604: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63992%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for VV63992: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: BP08183
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08183%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for BP08183: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: DZ95846
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT44032%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for ZT44032: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: UF05417
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: ZT61879
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT61879%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for ZT61879: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV19719%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for YV19719: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK34642%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for DK34642: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: UJ97267
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ97267%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for UJ97267: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: GT90987
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT90987%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for GT90987: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: UM32234
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: HT07247
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: AF88379
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: MT61619
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: GS31423
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS31423%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for GS31423: 0
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: EH64041
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH64041%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for EH64041: 2
2026-03-28 09:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b92de4c7-68b4-51f9-8d32-46f00a0f3455 with identifier: EH64041
2026-03-28 09:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b92de4c7-68b4-51f9-8d32-46f00a0f3455 with scrape type 2
2026-03-28 09:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b92de4c7-68b4-51f9-8d32-46f00a0f3455 with scrape type 2
2026-03-28 09:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b92de4c7-68b4-51f9-8d32-46f00a0f3455, identifier: EH64041
2026-03-28 09:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b92de4c7-68b4-51f9-8d32-46f00a0f3455 with identifier: EH64041
2026-03-28 09:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b92de4c7-68b4-51f9-8d32-46f00a0f3455 with identifier: EH64041
2026-03-28 09:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b92de4c7-68b4-51f9-8d32-46f00a0f3455 with identifier: EH64041 to the API
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:10:43Z',
 'fuel_type': 'diesel',
 'id': 'b92de4c7-68b4-51f9-8d32-46f00a0f3455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH64041',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 191568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-06',
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2014}
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH64041%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Saving data for EH64041: {'auction_closing_time': 1774714243.0, 'created_time': 1774473199.753091, 'last_price_update_time': 1774688832.764774}
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH64041') HTTP/1.1" 204 0
2026-03-28 09:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:12 [auto1.it] INFO: Found listing with ID: FX46616
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX46616%27 HTTP/1.1" 200 None
2026-03-28 09:07:12 [auto1.it] INFO: Scrape type for FX46616: 2
2026-03-28 09:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3779929f-2c80-51a5-ad31-4bdf9e88c4a6 with identifier: FX46616
2026-03-28 09:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3779929f-2c80-51a5-ad31-4bdf9e88c4a6 with scrape type 2
2026-03-28 09:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3779929f-2c80-51a5-ad31-4bdf9e88c4a6 with scrape type 2
2026-03-28 09:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3779929f-2c80-51a5-ad31-4bdf9e88c4a6, identifier: FX46616
2026-03-28 09:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3779929f-2c80-51a5-ad31-4bdf9e88c4a6 with identifier: FX46616
2026-03-28 09:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3779929f-2c80-51a5-ad31-4bdf9e88c4a6 with identifier: FX46616
2026-03-28 09:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3779929f-2c80-51a5-ad31-4bdf9e88c4a6 with identifier: FX46616 to the API
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:13Z',
 'fuel_type': 'diesel',
 'id': '3779929f-2c80-51a5-ad31-4bdf9e88c4a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX46616',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 142680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Crossover Style',
 'transmission': 'automatic',
 'trim': 'Crossover Style',
 'year': 2012}
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX46616%27 HTTP/1.1" 200 None
2026-03-28 09:07:13 [auto1.it] INFO: Saving data for FX46616: {'auction_closing_time': 1774717093.0, 'created_time': 1774473173.046126, 'last_price_update_time': 1774688833.260822}
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FX46616') HTTP/1.1" 204 0
2026-03-28 09:07:13 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG69305%27 HTTP/1.1" 200 None
2026-03-28 09:07:13 [auto1.it] INFO: Scrape type for PG69305: 0
2026-03-28 09:07:13 [auto1.it] INFO: Found listing with ID: BJ50784
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ50784%27 HTTP/1.1" 200 None
2026-03-28 09:07:13 [auto1.it] INFO: Scrape type for BJ50784: 0
2026-03-28 09:07:13 [auto1.it] INFO: Found listing with ID: CC86207
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC86207%27 HTTP/1.1" 200 None
2026-03-28 09:07:13 [auto1.it] INFO: Scrape type for CC86207: 2
2026-03-28 09:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1997212e-ccf3-5b6d-bc26-0db1e704a155 with identifier: CC86207
2026-03-28 09:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1997212e-ccf3-5b6d-bc26-0db1e704a155 with scrape type 2
2026-03-28 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1997212e-ccf3-5b6d-bc26-0db1e704a155 with scrape type 2
2026-03-28 09:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1997212e-ccf3-5b6d-bc26-0db1e704a155, identifier: CC86207
2026-03-28 09:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1997212e-ccf3-5b6d-bc26-0db1e704a155 with identifier: CC86207
2026-03-28 09:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1997212e-ccf3-5b6d-bc26-0db1e704a155 with identifier: CC86207
2026-03-28 09:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1997212e-ccf3-5b6d-bc26-0db1e704a155 with identifier: CC86207 to the API
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:02:02Z',
 'fuel_type': 'diesel',
 'id': '1997212e-ccf3-5b6d-bc26-0db1e704a155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC86207',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 150104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-19',
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC86207%27 HTTP/1.1" 200 None
2026-03-28 09:07:13 [auto1.it] INFO: Saving data for CC86207: {'auction_closing_time': 1774713722.0, 'created_time': 1772655437.257294, 'last_price_update_time': 1774688833.777814}
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CC86207') HTTP/1.1" 204 0
2026-03-28 09:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA37529> (referer: https://www.auto1.com/v1/car-details-view/BA37529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:13 [auto1.it] INFO: Found listing with ID: YK89440
2026-03-28 09:07:13 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-28 09:07:13 [auto1.it] INFO: Found listing with ID: PZ47386
2026-03-28 09:07:13 [auto1.it] INFO: Found listing with ID: SD88431
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD88431%27 HTTP/1.1" 200 None
2026-03-28 09:07:13 [auto1.it] INFO: Scrape type for SD88431: 2
2026-03-28 09:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86987ab6-4113-5cac-811d-1ec6b27147c2 with identifier: SD88431
2026-03-28 09:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86987ab6-4113-5cac-811d-1ec6b27147c2 with scrape type 2
2026-03-28 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86987ab6-4113-5cac-811d-1ec6b27147c2 with scrape type 2
2026-03-28 09:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 86987ab6-4113-5cac-811d-1ec6b27147c2, identifier: SD88431
2026-03-28 09:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 86987ab6-4113-5cac-811d-1ec6b27147c2 with identifier: SD88431
2026-03-28 09:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 86987ab6-4113-5cac-811d-1ec6b27147c2 with identifier: SD88431
2026-03-28 09:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 86987ab6-4113-5cac-811d-1ec6b27147c2 with identifier: SD88431 to the API
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:56:04Z',
 'fuel_type': 'diesel',
 'id': '86987ab6-4113-5cac-811d-1ec6b27147c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD88431',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 155649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD88431%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [auto1.it] INFO: Saving data for SD88431: {'auction_closing_time': 1774716964.0, 'created_time': 1773236572.542433, 'last_price_update_time': 1774688834.240671}
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD88431') HTTP/1.1" 204 0
2026-03-28 09:07:14 [auto1.it] INFO: Found listing with ID: DP81604
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP81604%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [auto1.it] INFO: Scrape type for DP81604: 0
2026-03-28 09:07:14 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-28 09:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529
2026-03-28 09:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f20df5-0fe6-5c92-be21-c0209b8bce27 with scrape type 1
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_952c241a8db77c709ebc862863d7cdaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_952c241a8db77c709ebc862863d7cdaf.jpg not downloaded yet
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_56e48b27dfab26277dab3964a7c0e395.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_56e48b27dfab26277dab3964a7c0e395.jpg not downloaded yet
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_7100833eaf32338a69ed083a0d1a0c26.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_7100833eaf32338a69ed083a0d1a0c26.jpg not downloaded yet
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_e3971d14d7acbde8ba2ed206a90e6554.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_e3971d14d7acbde8ba2ed206a90e6554.jpg not downloaded yet
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_a1d8f6f7eae80d026d5f375db2fe80d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_a1d8f6f7eae80d026d5f375db2fe80d3.jpg not downloaded yet
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_05fe166e58b5022b4e95a67785df3cd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_05fe166e58b5022b4e95a67785df3cd5.jpg not downloaded yet
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_952c241a8db77c709ebc862863d7cdaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_30cd04758dbf5787b5e02a5b32bfd74e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_30cd04758dbf5787b5e02a5b32bfd74e.jpg not downloaded yet
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_7100833eaf32338a69ed083a0d1a0c26.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_56e48b27dfab26277dab3964a7c0e395.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_d22374c9a2ad81d4c4944c84fa24ba7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d22374c9a2ad81d4c4944c84fa24ba7f.jpg not downloaded yet
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_d650c1d936a460791283ef0c45a89ce5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d650c1d936a460791283ef0c45a89ce5.jpg not downloaded yet
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_e3971d14d7acbde8ba2ed206a90e6554.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_91e935da411a05b3bbf58ec54b0bd1d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_91e935da411a05b3bbf58ec54b0bd1d2.jpg not downloaded yet
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_a1d8f6f7eae80d026d5f375db2fe80d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_05fe166e58b5022b4e95a67785df3cd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c0b3050>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_952c241a8db77c709ebc862863d7cdaf.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_952c241a8db77c709ebc862863d7cdaf.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d650c1d936a460791283ef0c45a89ce5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c18ced0>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_7100833eaf32338a69ed083a0d1a0c26.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_7100833eaf32338a69ed083a0d1a0c26.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c065cde10>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_56e48b27dfab26277dab3964a7c0e395.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_56e48b27dfab26277dab3964a7c0e395.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c089510>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_e3971d14d7acbde8ba2ed206a90e6554.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_e3971d14d7acbde8ba2ed206a90e6554.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c066d5fd0>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_a1d8f6f7eae80d026d5f375db2fe80d3.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_a1d8f6f7eae80d026d5f375db2fe80d3.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0d892150>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_05fe166e58b5022b4e95a67785df3cd5.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_05fe166e58b5022b4e95a67785df3cd5.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_91e935da411a05b3bbf58ec54b0bd1d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c31b1d0>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_d650c1d936a460791283ef0c45a89ce5.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d650c1d936a460791283ef0c45a89ce5.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_30cd04758dbf5787b5e02a5b32bfd74e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d22374c9a2ad81d4c4944c84fa24ba7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061fbd90>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_91e935da411a05b3bbf58ec54b0bd1d2.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_91e935da411a05b3bbf58ec54b0bd1d2.jpg saved to cache
2026-03-28 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c0c060a90>
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_30cd04758dbf5787b5e02a5b32bfd74e.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_30cd04758dbf5787b5e02a5b32bfd74e.jpg saved to cache
2026-03-28 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c061f9ed0>
2026-03-28 09:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99ee0c9cf7b3ab8030049ea91a9f3d29%252Fpa%252FBA37529_d22374c9a2ad81d4c4944c84fa24ba7f.jpg') HTTP/1.1" 204 0
2026-03-28 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d22374c9a2ad81d4c4944c84fa24ba7f.jpg saved to cache
2026-03-28 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3f20df5-0fe6-5c92-be21-c0209b8bce27
2026-03-28 09:07:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3f20df5-0fe6-5c92-be21-c0209b8bce27, skipping ID generation
2026-03-28 09:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f20df5-0fe6-5c92-be21-c0209b8bce27 with scrape type 1
2026-03-28 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3f20df5-0fe6-5c92-be21-c0209b8bce27 sending to next pipeline
2026-03-28 09:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3f20df5-0fe6-5c92-be21-c0209b8bce27, identifier: BA37529
2026-03-28 09:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529
2026-03-28 09:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529
2026-03-28 09:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529 to the API
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d22374c9a2ad81d4c4944c84fa24ba7f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:38Z',
 'fuel_type': 'diesel',
 'id': 'c3f20df5-0fe6-5c92-be21-c0209b8bce27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA37529',
 'listing': 'auction',
 'location': 'IT, Garbagnate Milanese',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 79875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_952c241a8db77c709ebc862863d7cdaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_56e48b27dfab26277dab3964a7c0e395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_7100833eaf32338a69ed083a0d1a0c26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_e3971d14d7acbde8ba2ed206a90e6554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_a1d8f6f7eae80d026d5f375db2fe80d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_05fe166e58b5022b4e95a67785df3cd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2027367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_30cd04758dbf5787b5e02a5b32bfd74e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d22374c9a2ad81d4c4944c84fa24ba7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_d650c1d936a460791283ef0c45a89ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f20df5-0fe6-5c92-be21-c0209b8bce27/c3f20df5-0fe6-5c92-be21-c0209b8bce27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99ee0c9cf7b3ab8030049ea91a9f3d29/pa/BA37529_91e935da411a05b3bbf58ec54b0bd1d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA37529%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Saving data for BA37529: {'created_time': 1774688835.70502, 'last_price_update_time': 1774688835.705029, 'auction_closing_time': 1774882838.0}
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA37529') HTTP/1.1" 204 0
2026-03-28 09:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:15 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: LD73585
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD73585%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for LD73585: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: LP02443
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: FB11512
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC52318%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for AC52318: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: NR89039
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR89039%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for NR89039: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: BC74314
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC74314%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for BC74314: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: HU90356
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: AU61443
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU61443%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for AU61443: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: LS03457
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS03457%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for LS03457: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: SU12582
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH03473%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for CH03473: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: BF84159
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF84159%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for BF84159: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: LP76273
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP76273%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for LP76273: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: WD39478
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: AB43384
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS05902%27 HTTP/1.1" 200 None
2026-03-28 09:07:15 [auto1.it] INFO: Scrape type for CS05902: 0
2026-03-28 09:07:15 [auto1.it] INFO: Found listing with ID: LY95127
2026-03-28 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY95127%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for LY95127: 0
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: NN95348
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: RR71637
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR71637%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for RR71637: 0
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: YT62048
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT62048%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for YT62048: 0
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: HN00760
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN00760%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for HN00760: 0
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: TA79833
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: VH62552
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: JV70876
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV70876%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for JV70876: 0
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: NY67397
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: GG13380
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: EF94220
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: SP82579
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: LJ38222
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22945%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for HY22945: 0
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: PY49742
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY49742%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for PY49742: 2
2026-03-28 09:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742
2026-03-28 09:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d2d594-b4e5-54ce-8b11-6307289c537a with scrape type 2
2026-03-28 09:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d2d594-b4e5-54ce-8b11-6307289c537a with scrape type 2
2026-03-28 09:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18d2d594-b4e5-54ce-8b11-6307289c537a, identifier: PY49742
2026-03-28 09:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742
2026-03-28 09:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742
2026-03-28 09:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742 to the API
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:18:59Z',
 'fuel_type': 'diesel',
 'id': '18d2d594-b4e5-54ce-8b11-6307289c537a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY49742',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 270274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY49742%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Saving data for PY49742: {'auction_closing_time': 1774714739.0, 'created_time': 1774473038.021368, 'last_price_update_time': 1774688836.512896}
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PY49742') HTTP/1.1" 204 0
2026-03-28 09:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: VX37353
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: ZP51405
2026-03-28 09:07:16 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG41470%27 HTTP/1.1" 200 None
2026-03-28 09:07:16 [auto1.it] INFO: Scrape type for EG41470: 0
2026-03-28 09:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:17 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: UD85899
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: ZM49441
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: VV14244
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV14244%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for VV14244: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: JR03876
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: VH71925
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: CC36566
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: RT91263
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP99832%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for VP99832: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS58810%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for DS58810: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: HS83274
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS83274%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for HS83274: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA76603%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for LA76603: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: XN65989
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: UP48367
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for UP48367: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD54235%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for HD54235: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: HS60587
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: TX80961
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: BP45354
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: SS67586
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS67586%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for SS67586: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: ZW77638
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: DS11019
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: MT42798
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21125%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for AY21125: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: XF71251
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG03340%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for YG03340: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV87754%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for HV87754: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: UE23071
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: SP98700
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP98700%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for SP98700: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: CH78028
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH78028%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for CH78028: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: VZ89804
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ89804%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for VZ89804: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: AT32399
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: LC14849
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ96008%27 HTTP/1.1" 200 None
2026-03-28 09:07:17 [auto1.it] INFO: Scrape type for WJ96008: 0
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-28 09:07:17 [auto1.it] INFO: Found listing with ID: RR40401
2026-03-28 09:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:19 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: TA22060
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA22060%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for TA22060: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: ZW69892
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS11522%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for VS11522: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: NU78956
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU78956%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for NU78956: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT72554%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for PT72554: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: FU36199
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: DJ66527
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ66527%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for DJ66527: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: EC51019
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: CH88707
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH88707%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for CH88707: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: WL70343
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: JD09994
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA32249%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for AA32249: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: AX60042
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: NN95862
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN95862%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for NN95862: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: MH62974
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: KZ03059
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: BA03672
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: DY31540
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: WG30264
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: DB60512
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB60512%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for DB60512: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER97620%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for ER97620: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: LW22359
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: XA69003
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA69003%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for XA69003: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA25945%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for FA25945: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: XH39362
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH39362%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for XH39362: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: EE84208
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE84208%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for EE84208: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: AM77280
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM77280%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for AM77280: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: VH07550
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH07550%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for VH07550: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW53696%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for DW53696: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA02667%27 HTTP/1.1" 200 None
2026-03-28 09:07:19 [auto1.it] INFO: Scrape type for HA02667: 0
2026-03-28 09:07:19 [auto1.it] INFO: Found listing with ID: VF37743
2026-03-28 09:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:20 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: YF99217
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: DY73296
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: EG78333
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58212%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for PY58212: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: RL06920
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: GK45626
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK45626%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for GK45626: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: TY80704
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY80704%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for TY80704: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: LW64667
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: AG51649
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG51649%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for AG51649: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: AZ56413
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ56413%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for AZ56413: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV65529%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for EV65529: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: HK54342
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: TD67992
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: BD83162
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD83162%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for BD83162: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: WZ30101
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ30101%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for WZ30101: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP75199%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for FP75199: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: KX92942
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX92942%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for KX92942: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: HC85966
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC85966%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for HC85966: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: NB44357
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: NV42271
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV42271%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for NV42271: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS16004%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for CS16004: 0
2026-03-28 09:07:20 [auto1.it] INFO: Found listing with ID: YA80598
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA80598%27 HTTP/1.1" 200 None
2026-03-28 09:07:20 [auto1.it] INFO: Scrape type for YA80598: 2
2026-03-28 09:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 115ea41c-bf57-5b74-ba6f-e88d742e10f0 with identifier: YA80598
2026-03-28 09:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115ea41c-bf57-5b74-ba6f-e88d742e10f0 with scrape type 2
2026-03-28 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 115ea41c-bf57-5b74-ba6f-e88d742e10f0 with scrape type 2
2026-03-28 09:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 115ea41c-bf57-5b74-ba6f-e88d742e10f0, identifier: YA80598
2026-03-28 09:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 115ea41c-bf57-5b74-ba6f-e88d742e10f0 with identifier: YA80598
2026-03-28 09:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 115ea41c-bf57-5b74-ba6f-e88d742e10f0 with identifier: YA80598
2026-03-28 09:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 115ea41c-bf57-5b74-ba6f-e88d742e10f0 with identifier: YA80598 to the API
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:48:26Z',
 'fuel_type': 'diesel',
 'id': '115ea41c-bf57-5b74-ba6f-e88d742e10f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA80598',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 179673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA80598%27 HTTP/1.1" 200 None
2026-03-28 09:07:21 [auto1.it] INFO: Saving data for YA80598: {'auction_closing_time': 1774716506.0, 'created_time': 1773269087.046654, 'last_price_update_time': 1774688841.238839}
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA80598') HTTP/1.1" 204 0
2026-03-28 09:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: EX06021
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: MS41612
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: RN15914
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN15914%27 HTTP/1.1" 200 None
2026-03-28 09:07:21 [auto1.it] INFO: Scrape type for RN15914: 0
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: WE89582
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE89582%27 HTTP/1.1" 200 None
2026-03-28 09:07:21 [auto1.it] INFO: Scrape type for WE89582: 0
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: EF87195
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: WE25816
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE25816%27 HTTP/1.1" 200 None
2026-03-28 09:07:21 [auto1.it] INFO: Scrape type for WE25816: 0
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: HE61861
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE61861%27 HTTP/1.1" 200 None
2026-03-28 09:07:21 [auto1.it] INFO: Scrape type for HE61861: 0
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: ZP49610
2026-03-28 09:07:21 [auto1.it] INFO: Found listing with ID: JF46642
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF46642%27 HTTP/1.1" 200 None
2026-03-28 09:07:21 [auto1.it] INFO: Scrape type for JF46642: 2
2026-03-28 09:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642
2026-03-28 09:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77aae8ee-0df6-5107-9f7e-aba058099b0c with scrape type 2
2026-03-28 09:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77aae8ee-0df6-5107-9f7e-aba058099b0c with scrape type 2
2026-03-28 09:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77aae8ee-0df6-5107-9f7e-aba058099b0c, identifier: JF46642
2026-03-28 09:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642
2026-03-28 09:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642
2026-03-28 09:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642 to the API
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:38:16Z',
 'fuel_type': 'petrol',
 'id': '77aae8ee-0df6-5107-9f7e-aba058099b0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF46642',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 210938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'Citroen C3 1.1 Séduction',
 'transmission': 'manual',
 'trim': 'Séduction',
 'year': 2012}
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF46642%27 HTTP/1.1" 200 None
2026-03-28 09:07:21 [auto1.it] INFO: Saving data for JF46642: {'auction_closing_time': 1774715896.0, 'created_time': 1773270379.045907, 'last_price_update_time': 1774688841.982849}
2026-03-28 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF46642') HTTP/1.1" 204 0
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-28 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD12623%27 HTTP/1.1" 200 None
2026-03-28 09:07:22 [auto1.it] INFO: Scrape type for PD12623: 0
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: KZ30481
2026-03-28 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ30481%27 HTTP/1.1" 200 None
2026-03-28 09:07:22 [auto1.it] INFO: Scrape type for KZ30481: 0
2026-03-28 09:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:22 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: XG03695
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: ZM05911
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: SK71918
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: RY16068
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-28 09:07:22 [auto1.it] INFO: Found listing with ID: HA95428
2026-03-28 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA95428%27 HTTP/1.1" 200 None
2026-03-28 09:07:22 [auto1.it] INFO: Scrape type for HA95428: 2
2026-03-28 09:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76e761ae-5443-5b37-b6c2-b1258c3d938e with identifier: HA95428
2026-03-28 09:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76e761ae-5443-5b37-b6c2-b1258c3d938e with scrape type 2
2026-03-28 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76e761ae-5443-5b37-b6c2-b1258c3d938e with scrape type 2
2026-03-28 09:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 76e761ae-5443-5b37-b6c2-b1258c3d938e, identifier: HA95428
2026-03-28 09:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 76e761ae-5443-5b37-b6c2-b1258c3d938e with identifier: HA95428
2026-03-28 09:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 76e761ae-5443-5b37-b6c2-b1258c3d938e with identifier: HA95428
2026-03-28 09:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 76e761ae-5443-5b37-b6c2-b1258c3d938e with identifier: HA95428 to the API
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:15:57Z',
 'fuel_type': 'diesel',
 'id': '76e761ae-5443-5b37-b6c2-b1258c3d938e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA95428',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 132183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi XPossible 2WD',
 'transmission': 'manual',
 'trim': 'XPossible 2WD',
 'year': 2014}
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA95428%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Saving data for HA95428: {'auction_closing_time': 1774714557.0, 'created_time': 1774473139.263017, 'last_price_update_time': 1774688843.384432}
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HA95428') HTTP/1.1" 204 0
2026-03-28 09:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: YV30830
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV30830%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for YV30830: 0
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: GW68034
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW68034%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for GW68034: 0
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: GY41303
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: JN64307
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN64307%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for JN64307: 0
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: DT10688
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT10688%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for DT10688: 0
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW88913%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for KW88913: 0
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: WR05757
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR05757%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for WR05757: 0
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: KN14536
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN14536%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for KN14536: 0
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: GR13537
2026-03-28 09:07:23 [auto1.it] INFO: Found listing with ID: PU36388
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU36388%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Scrape type for PU36388: 2
2026-03-28 09:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e39e475-fc2a-5e2f-8c31-f77116c33bbe with identifier: PU36388
2026-03-28 09:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e39e475-fc2a-5e2f-8c31-f77116c33bbe with scrape type 2
2026-03-28 09:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e39e475-fc2a-5e2f-8c31-f77116c33bbe with scrape type 2
2026-03-28 09:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e39e475-fc2a-5e2f-8c31-f77116c33bbe, identifier: PU36388
2026-03-28 09:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e39e475-fc2a-5e2f-8c31-f77116c33bbe with identifier: PU36388
2026-03-28 09:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e39e475-fc2a-5e2f-8c31-f77116c33bbe with identifier: PU36388
2026-03-28 09:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e39e475-fc2a-5e2f-8c31-f77116c33bbe with identifier: PU36388 to the API
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:05:04Z',
 'fuel_type': 'petrol',
 'id': '2e39e475-fc2a-5e2f-8c31-f77116c33bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU36388',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 184377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-01',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU36388%27 HTTP/1.1" 200 None
2026-03-28 09:07:23 [auto1.it] INFO: Saving data for PU36388: {'auction_closing_time': 1774713904.0, 'created_time': 1773997715.94448, 'last_price_update_time': 1774688843.949832}
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PU36388') HTTP/1.1" 204 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: CJ46241
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ46241%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for CJ46241: 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: DF43050
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: PN79982
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: VS33073
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: GR09815
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR09815%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for GR09815: 2
2026-03-28 09:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b2429c-bf2e-5495-94d5-2eb269ef77ef with identifier: GR09815
2026-03-28 09:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b2429c-bf2e-5495-94d5-2eb269ef77ef with scrape type 2
2026-03-28 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b2429c-bf2e-5495-94d5-2eb269ef77ef with scrape type 2
2026-03-28 09:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2b2429c-bf2e-5495-94d5-2eb269ef77ef, identifier: GR09815
2026-03-28 09:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2b2429c-bf2e-5495-94d5-2eb269ef77ef with identifier: GR09815
2026-03-28 09:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2b2429c-bf2e-5495-94d5-2eb269ef77ef with identifier: GR09815
2026-03-28 09:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2b2429c-bf2e-5495-94d5-2eb269ef77ef with identifier: GR09815 to the API
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:40Z',
 'fuel_type': 'diesel',
 'id': 'f2b2429c-bf2e-5495-94d5-2eb269ef77ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR09815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 81625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR09815%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Saving data for GR09815: {'auction_closing_time': 1774713640.0, 'created_time': 1774473174.472879, 'last_price_update_time': 1774688844.501329}
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR09815') HTTP/1.1" 204 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: RG52060
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG52060%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for RG52060: 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: CV33669
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV33669%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for CV33669: 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: CC54288
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: BX02357
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX02357%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for BX02357: 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: GH50385
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: JK53283
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK53283%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for JK53283: 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF95895%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for JF95895: 0
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: CS89848
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: UY09098
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: CP19767
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-28 09:07:24 [auto1.it] INFO: Found listing with ID: SU00968
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU00968%27 HTTP/1.1" 200 None
2026-03-28 09:07:24 [auto1.it] INFO: Scrape type for SU00968: 0
2026-03-28 09:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:25 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: NT59940
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46265%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for JA46265: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: RR88002
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR88002%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for RR88002: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: ZS89496
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS89496%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for ZS89496: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF91623%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for LF91623: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44721%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for EB44721: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ05140%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for TZ05140: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: NG93941
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG93941%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for NG93941: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL26741%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for NL26741: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF95758%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for BF95758: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG12773%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for LG12773: 0
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: SK24078
2026-03-28 09:07:25 [auto1.it] INFO: Found listing with ID: AN86148
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN86148%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Scrape type for AN86148: 2
2026-03-28 09:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 608b4d0b-db8d-5d9a-8f26-a3d8850c1378 with identifier: AN86148
2026-03-28 09:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 608b4d0b-db8d-5d9a-8f26-a3d8850c1378 with scrape type 2
2026-03-28 09:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 608b4d0b-db8d-5d9a-8f26-a3d8850c1378 with scrape type 2
2026-03-28 09:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 608b4d0b-db8d-5d9a-8f26-a3d8850c1378, identifier: AN86148
2026-03-28 09:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 608b4d0b-db8d-5d9a-8f26-a3d8850c1378 with identifier: AN86148
2026-03-28 09:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 608b4d0b-db8d-5d9a-8f26-a3d8850c1378 with identifier: AN86148
2026-03-28 09:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 608b4d0b-db8d-5d9a-8f26-a3d8850c1378 with identifier: AN86148 to the API
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:11:49Z',
 'fuel_type': 'diesel',
 'id': '608b4d0b-db8d-5d9a-8f26-a3d8850c1378',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN86148',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 171255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 D4 Pro AWD',
 'transmission': 'automatic',
 'trim': 'Pro AWD',
 'year': 2019}
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN86148%27 HTTP/1.1" 200 None
2026-03-28 09:07:25 [auto1.it] INFO: Saving data for AN86148: {'auction_closing_time': 1774714309.0, 'created_time': 1774473171.879616, 'last_price_update_time': 1774688845.93579}
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN86148') HTTP/1.1" 204 0
2026-03-28 09:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: EM78419
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM78419%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for EM78419: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: TT32643
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD67829%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for GD67829: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: RA70814
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA70814%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for RA70814: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: BX38119
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55609%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for FR55609: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW61080%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for ZW61080: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: ZN01061
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN01061%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for ZN01061: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: PY10905
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY10905%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for PY10905: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: AR54345
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH71659%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for HH71659: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: NZ65760
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: EZ92268
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: SS19742
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: UA22723
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA22723%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for UA22723: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: WN10249
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN10249%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for WN10249: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: BS22593
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS22593%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for BS22593: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: RS53925
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF98355%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for WF98355: 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: KK16501
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: AL46410
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: EY73607
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY73607%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for EY73607: 2
2026-03-28 09:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03600e25-a629-56ea-957e-ae340774012c with identifier: EY73607
2026-03-28 09:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03600e25-a629-56ea-957e-ae340774012c with scrape type 2
2026-03-28 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03600e25-a629-56ea-957e-ae340774012c with scrape type 2
2026-03-28 09:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 03600e25-a629-56ea-957e-ae340774012c, identifier: EY73607
2026-03-28 09:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 03600e25-a629-56ea-957e-ae340774012c with identifier: EY73607
2026-03-28 09:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 03600e25-a629-56ea-957e-ae340774012c with identifier: EY73607
2026-03-28 09:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 03600e25-a629-56ea-957e-ae340774012c with identifier: EY73607 to the API
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:54:20Z',
 'fuel_type': 'diesel',
 'id': '03600e25-a629-56ea-957e-ae340774012c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY73607',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 157741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.2 Diesel D LTZ 4WD',
 'transmission': 'automatic',
 'trim': 'D LTZ 4WD',
 'year': 2011}
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY73607%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Saving data for EY73607: {'auction_closing_time': 1774716860.0, 'created_time': 1774473133.300976, 'last_price_update_time': 1774688846.665459}
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY73607') HTTP/1.1" 204 0
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: NR08149
2026-03-28 09:07:26 [auto1.it] INFO: Found listing with ID: BR68512
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR68512%27 HTTP/1.1" 200 None
2026-03-28 09:07:26 [auto1.it] INFO: Scrape type for BR68512: 0
2026-03-28 09:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:28 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: ED61814
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED61814%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for ED61814: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: EW91722
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC71555%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for JC71555: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: ZF01645
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01645%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for ZF01645: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX47141%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for NX47141: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: DN07271
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN07271%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for DN07271: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: GY11839
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY11839%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for GY11839: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV12122%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for AV12122: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: TW69998
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: WX96902
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84284%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for ZZ84284: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: ST13349
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST13349%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for ST13349: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT74871%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for AT74871: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ72377%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for LZ72377: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE71737%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for ZE71737: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: LG98930
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG98930%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for LG98930: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: CX09724
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX09724%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for CX09724: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: MK54778
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK54778%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for MK54778: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ08956%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for PZ08956: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: XY83174
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: JK67025
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: WS86026
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS86026%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for WS86026: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: ZA88698
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10461%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for PM10461: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: SP76213
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76213%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for SP76213: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: VM52207
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: HA26046
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX10481%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for KX10481: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: YH31612
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH31612%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for YH31612: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: YM20104
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM20104%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for YM20104: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW69655%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for NW69655: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: GS12960
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS12960%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for GS12960: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: LL73922
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL73922%27 HTTP/1.1" 200 None
2026-03-28 09:07:28 [auto1.it] INFO: Scrape type for LL73922: 0
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: CV08843
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: RT64884
2026-03-28 09:07:28 [auto1.it] INFO: Found listing with ID: YX93099
2026-03-28 09:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:29 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD31675%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for TD31675: 0
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: VX61752
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: UX48429
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: AX27463
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: EB51163
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: UH08527
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: HR07647
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ46449%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for PJ46449: 0
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: ZY55169
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX95672%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for GX95672: 0
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: AA77653
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74969%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for LK74969: 0
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: CB30744
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: SN57039
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: KL78509
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL78509%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for KL78509: 0
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: KU41331
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG15136%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for TG15136: 0
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: JF99544
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: JC73899
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC73899%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for JC73899: 0
2026-03-28 09:07:29 [auto1.it] INFO: Found listing with ID: ZA39687
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA39687%27 HTTP/1.1" 200 None
2026-03-28 09:07:29 [auto1.it] INFO: Scrape type for ZA39687: 2
2026-03-28 09:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9 with identifier: ZA39687
2026-03-28 09:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9 with scrape type 2
2026-03-28 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9 with scrape type 2
2026-03-28 09:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9, identifier: ZA39687
2026-03-28 09:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9 with identifier: ZA39687
2026-03-28 09:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9 with identifier: ZA39687
2026-03-28 09:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9 with identifier: ZA39687 to the API
2026-03-28 09:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:36:04Z',
 'fuel_type': 'petrol',
 'id': '62da71b4-81a2-5dc8-ae0a-1c831a0d6eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA39687',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 54006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-03-28 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA39687%27 HTTP/1.1" 200 None
2026-03-28 09:07:30 [auto1.it] INFO: Saving data for ZA39687: {'auction_closing_time': 1774715764.0, 'created_time': 1774473006.37452, 'last_price_update_time': 1774688850.884325}
2026-03-28 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZA39687') HTTP/1.1" 204 0
2026-03-28 09:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR96571%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for JR96571: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK86990%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for CK86990: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU76175%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for KU76175: 2
2026-03-28 09:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175
2026-03-28 09:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a08176-b56c-51f3-8e7a-5c88ed940e34 with scrape type 2
2026-03-28 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a08176-b56c-51f3-8e7a-5c88ed940e34 with scrape type 2
2026-03-28 09:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6a08176-b56c-51f3-8e7a-5c88ed940e34, identifier: KU76175
2026-03-28 09:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 09:07:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175
2026-03-28 09:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175 to the API
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:35:56Z',
 'fuel_type': 'gas',
 'id': 'a6a08176-b56c-51f3-8e7a-5c88ed940e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU76175',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 44854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-11',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme Up',
 'transmission': 'manual',
 'trim': 'Extreme Up',
 'year': 2022}
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU76175%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Saving data for KU76175: {'auction_closing_time': 1774715756.0, 'created_time': 1774473028.430831, 'last_price_update_time': 1774688851.816601}
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KU76175') HTTP/1.1" 204 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF25963%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for FF25963: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR16589%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for SR16589: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: HU73227
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU73227%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for HU73227: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: PR39180
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR39180%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for PR39180: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: LW03785
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW03785%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for LW03785: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: PZ70422
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: AL46390
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: HP25104
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP25104%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for HP25104: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: BF43503
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA46767%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for RA46767: 0
2026-03-28 09:07:31 [auto1.it] INFO: Found listing with ID: ZH71174
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH71174%27 HTTP/1.1" 200 None
2026-03-28 09:07:31 [auto1.it] INFO: Scrape type for ZH71174: 2
2026-03-28 09:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2e2b43-38d6-558d-8de8-2c56aa59b356 with identifier: ZH71174
2026-03-28 09:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2e2b43-38d6-558d-8de8-2c56aa59b356 with scrape type 2
2026-03-28 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2e2b43-38d6-558d-8de8-2c56aa59b356 with scrape type 2
2026-03-28 09:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d2e2b43-38d6-558d-8de8-2c56aa59b356, identifier: ZH71174
2026-03-28 09:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d2e2b43-38d6-558d-8de8-2c56aa59b356 with identifier: ZH71174
2026-03-28 09:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d2e2b43-38d6-558d-8de8-2c56aa59b356 with identifier: ZH71174
2026-03-28 09:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3d2e2b43-38d6-558d-8de8-2c56aa59b356 with identifier: ZH71174 to the API
2026-03-28 09:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:08:13Z',
 'fuel_type': 'diesel',
 'id': '3d2e2b43-38d6-558d-8de8-2c56aa59b356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH71174',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'QX30',
 'odometer': 153606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Infiniti QX30 2.2 Diesel Premium Tech',
 'transmission': 'automatic',
 'trim': 'Premium Tech',
 'year': 2017}
2026-03-28 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH71174%27 HTTP/1.1" 200 None
2026-03-28 09:07:32 [auto1.it] INFO: Saving data for ZH71174: {'auction_closing_time': 1774714093.0, 'created_time': 1774473172.248711, 'last_price_update_time': 1774688852.334901}
2026-03-28 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH71174') HTTP/1.1" 204 0
2026-03-28 09:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:33 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:33 [auto1.it] INFO: Found listing with ID: AP00004
2026-03-28 09:07:33 [auto1.it] INFO: Found listing with ID: VJ49724
2026-03-28 09:07:33 [auto1.it] INFO: Found listing with ID: VG29105
2026-03-28 09:07:33 [auto1.it] INFO: Found listing with ID: CB60846
2026-03-28 09:07:33 [auto1.it] INFO: Found listing with ID: ZU34198
2026-03-28 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU34198%27 HTTP/1.1" 200 None
2026-03-28 09:07:33 [auto1.it] INFO: Scrape type for ZU34198: 0
2026-03-28 09:07:33 [auto1.it] INFO: Found listing with ID: TW04222
2026-03-28 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW04222%27 HTTP/1.1" 200 None
2026-03-28 09:07:33 [auto1.it] INFO: Scrape type for TW04222: 2
2026-03-28 09:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1201d2b-891c-569b-9c0f-d1c047354393 with identifier: TW04222
2026-03-28 09:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1201d2b-891c-569b-9c0f-d1c047354393 with scrape type 2
2026-03-28 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1201d2b-891c-569b-9c0f-d1c047354393 with scrape type 2
2026-03-28 09:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d1201d2b-891c-569b-9c0f-d1c047354393, identifier: TW04222
2026-03-28 09:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d1201d2b-891c-569b-9c0f-d1c047354393 with identifier: TW04222
2026-03-28 09:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d1201d2b-891c-569b-9c0f-d1c047354393 with identifier: TW04222
2026-03-28 09:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d1201d2b-891c-569b-9c0f-d1c047354393 with identifier: TW04222 to the API
2026-03-28 09:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:56Z',
 'fuel_type': 'diesel',
 'id': 'd1201d2b-891c-569b-9c0f-d1c047354393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW04222',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 26892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Style BlueMotion',
 'transmission': 'automatic',
 'trim': 'Style BlueMotion',
 'year': 2017}
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW04222%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Saving data for TW04222: {'auction_closing_time': 1774715756.0, 'created_time': 1773236905.97177, 'last_price_update_time': 1774688854.411313}
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW04222') HTTP/1.1" 204 0
2026-03-28 09:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: CB25121
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: DA23296
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: PN87184
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN87184%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for PN87184: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: NV88375
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: BA93594
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: YM08087
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: CM37896
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK96047%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for EK96047: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: JD15995
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD15995%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for JD15995: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: LW17354
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: JS97160
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: TZ48601
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: AY64399
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY64399%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for AY64399: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: SG52105
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG52105%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for SG52105: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: YV94917
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: SD31467
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: YH31345
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH31345%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for YH31345: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: AF62726
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF62726%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for AF62726: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW24266%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for CW24266: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: YD38640
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD38640%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for YD38640: 0
2026-03-28 09:07:34 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF26556%27 HTTP/1.1" 200 None
2026-03-28 09:07:34 [auto1.it] INFO: Scrape type for NF26556: 2
2026-03-28 09:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556
2026-03-28 09:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ed4135-2f3e-5710-b32e-7aab4958987a with scrape type 2
2026-03-28 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ed4135-2f3e-5710-b32e-7aab4958987a with scrape type 2
2026-03-28 09:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e1ed4135-2f3e-5710-b32e-7aab4958987a, identifier: NF26556
2026-03-28 09:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556
2026-03-28 09:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556
2026-03-28 09:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556 to the API
2026-03-28 09:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:33:56Z',
 'fuel_type': 'petrol',
 'id': 'e1ed4135-2f3e-5710-b32e-7aab4958987a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF26556',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 132267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF26556%27 HTTP/1.1" 200 None
2026-03-28 09:07:35 [auto1.it] INFO: Saving data for NF26556: {'auction_closing_time': 1774715636.0, 'created_time': 1773781763.787489, 'last_price_update_time': 1774688855.897562}
2026-03-28 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF26556') HTTP/1.1" 204 0
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: VN28128
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: PS25996
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: JL83734
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: WG31996
2026-03-28 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG31996%27 HTTP/1.1" 200 None
2026-03-28 09:07:36 [auto1.it] INFO: Scrape type for WG31996: 0
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: PL66586
2026-03-28 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL66586%27 HTTP/1.1" 200 None
2026-03-28 09:07:36 [auto1.it] INFO: Scrape type for PL66586: 0
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-28 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH27811%27 HTTP/1.1" 200 None
2026-03-28 09:07:36 [auto1.it] INFO: Scrape type for TH27811: 0
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: HT57713
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: KD83488
2026-03-28 09:07:36 [auto1.it] INFO: Found listing with ID: DC26275
2026-03-28 09:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:37 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:37 [auto1.it] INFO: Found listing with ID: VX48328
2026-03-28 09:07:37 [auto1.it] INFO: Found listing with ID: HU51198
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU51198%27 HTTP/1.1" 200 None
2026-03-28 09:07:37 [auto1.it] INFO: Scrape type for HU51198: 0
2026-03-28 09:07:37 [auto1.it] INFO: Found listing with ID: WP70299
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP70299%27 HTTP/1.1" 200 None
2026-03-28 09:07:37 [auto1.it] INFO: Scrape type for WP70299: 0
2026-03-28 09:07:37 [auto1.it] INFO: Found listing with ID: EA17133
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA17133%27 HTTP/1.1" 200 None
2026-03-28 09:07:37 [auto1.it] INFO: Scrape type for EA17133: 2
2026-03-28 09:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133
2026-03-28 09:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with scrape type 2
2026-03-28 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with scrape type 2
2026-03-28 09:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e, identifier: EA17133
2026-03-28 09:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133
2026-03-28 09:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133
2026-03-28 09:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133 to the API
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:50Z',
 'fuel_type': 'diesel',
 'id': '12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA17133',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 328862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA17133%27 HTTP/1.1" 200 None
2026-03-28 09:07:37 [auto1.it] INFO: Saving data for EA17133: {'auction_closing_time': 1774714790.0, 'created_time': 1773237345.862387, 'last_price_update_time': 1774688857.917102}
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA17133') HTTP/1.1" 204 0
2026-03-28 09:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: AU09842
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU09842%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for AU09842: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: VS08893
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: RP80474
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: LY27741
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55523%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for SE55523: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA36833%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for TA36833: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: HY06064
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY06064%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for HY06064: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ47839%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for GZ47839: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: MN87452
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN87452%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for MN87452: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY19791%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for XY19791: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: NB30939
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA75240%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for TA75240: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: PA17142
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA17142%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for PA17142: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL87170%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for FL87170: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: FB70845
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB70845%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for FB70845: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: AU70231
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: EZ99260
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ99260%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for EZ99260: 2
2026-03-28 09:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2931017-7cd6-56db-9bcd-6528f5a68d16 with identifier: EZ99260
2026-03-28 09:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2931017-7cd6-56db-9bcd-6528f5a68d16 with scrape type 2
2026-03-28 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2931017-7cd6-56db-9bcd-6528f5a68d16 with scrape type 2
2026-03-28 09:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2931017-7cd6-56db-9bcd-6528f5a68d16, identifier: EZ99260
2026-03-28 09:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2931017-7cd6-56db-9bcd-6528f5a68d16 with identifier: EZ99260
2026-03-28 09:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2931017-7cd6-56db-9bcd-6528f5a68d16 with identifier: EZ99260
2026-03-28 09:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2931017-7cd6-56db-9bcd-6528f5a68d16 with identifier: EZ99260 to the API
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:42Z',
 'fuel_type': 'diesel',
 'id': 'f2931017-7cd6-56db-9bcd-6528f5a68d16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ99260',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 253914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-12',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2009}
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ99260%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Saving data for EZ99260: {'auction_closing_time': 1774717122.0, 'created_time': 1774473176.82351, 'last_price_update_time': 1774688858.600494}
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ99260') HTTP/1.1" 204 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: DG86254
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: RG08073
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: KJ53675
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT65910%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for BT65910: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: GJ83032
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ83032%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for GJ83032: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: JK56152
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK56152%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for JK56152: 0
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: NZ90613
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: JH99386
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-28 09:07:38 [auto1.it] INFO: Found listing with ID: LT53678
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT53678%27 HTTP/1.1" 200 None
2026-03-28 09:07:38 [auto1.it] INFO: Scrape type for LT53678: 2
2026-03-28 09:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678
2026-03-28 09:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc50140a-8a38-53c2-a782-24480f99b83c with scrape type 2
2026-03-28 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc50140a-8a38-53c2-a782-24480f99b83c with scrape type 2
2026-03-28 09:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cc50140a-8a38-53c2-a782-24480f99b83c, identifier: LT53678
2026-03-28 09:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678
2026-03-28 09:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678
2026-03-28 09:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678 to the API
2026-03-28 09:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:25Z',
 'fuel_type': 'diesel',
 'id': 'cc50140a-8a38-53c2-a782-24480f99b83c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT53678',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 369060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Audi A4 35 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT53678%27 HTTP/1.1" 200 None
2026-03-28 09:07:39 [auto1.it] INFO: Saving data for LT53678: {'auction_closing_time': 1774715485.0, 'created_time': 1774473188.65781, 'last_price_update_time': 1774688859.904333}
2026-03-28 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LT53678') HTTP/1.1" 204 0
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: FU79114
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: UN42756
2026-03-28 09:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:40 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 3440 | hits on page: 40
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: SZ24732
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: WT09600
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: XN00477
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: EP46295
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-28 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG66384%27 HTTP/1.1" 200 None
2026-03-28 09:07:40 [auto1.it] INFO: Scrape type for FG66384: 0
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: HB99393
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: ZM53307
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: CN94330
2026-03-28 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN94330%27 HTTP/1.1" 200 None
2026-03-28 09:07:40 [auto1.it] INFO: Scrape type for CN94330: 0
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: ME96207
2026-03-28 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME96207%27 HTTP/1.1" 200 None
2026-03-28 09:07:40 [auto1.it] INFO: Scrape type for ME96207: 0
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-28 09:07:40 [auto1.it] INFO: Found listing with ID: PL88516
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL88516%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for PL88516: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: AB63446
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB63446%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for AB63446: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: AG45482
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: UT31107
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: KU20000
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: BR59197
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: GL68572
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: DD73045
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD73045%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for DD73045: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: US62865
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB10041%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for VB10041: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: LS85229
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: TM85458
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: UW44918
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: ZD06174
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD06174%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for ZD06174: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: BE09297
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: ZM37074
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM37074%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for ZM37074: 2
2026-03-28 09:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074
2026-03-28 09:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57fd59d4-95ce-5576-bfad-ddae572ef585 with scrape type 2
2026-03-28 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57fd59d4-95ce-5576-bfad-ddae572ef585 with scrape type 2
2026-03-28 09:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57fd59d4-95ce-5576-bfad-ddae572ef585, identifier: ZM37074
2026-03-28 09:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074
2026-03-28 09:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074
2026-03-28 09:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074 to the API
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:33Z',
 'fuel_type': 'diesel',
 'id': '57fd59d4-95ce-5576-bfad-ddae572ef585',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM37074',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 182770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM37074%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Saving data for ZM37074: {'auction_closing_time': 1774714353.0, 'created_time': 1773231405.151091, 'last_price_update_time': 1774688861.486948}
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM37074') HTTP/1.1" 204 0
2026-03-28 09:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: DZ91111
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ91111%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for DZ91111: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: PL95293
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL95293%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for PL95293: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: LC48470
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: XT06571
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT06571%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for XT06571: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: ZR51869
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR51869%27 HTTP/1.1" 200 None
2026-03-28 09:07:41 [auto1.it] INFO: Scrape type for ZR51869: 0
2026-03-28 09:07:41 [auto1.it] INFO: Found listing with ID: XL05283
2026-03-28 09:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:42 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: XL05283
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: RC86938
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: EV67408
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67408%27 HTTP/1.1" 200 None
2026-03-28 09:07:42 [auto1.it] INFO: Scrape type for EV67408: 0
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: BX32751
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: HX97698
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: LU41088
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU41088%27 HTTP/1.1" 200 None
2026-03-28 09:07:42 [auto1.it] INFO: Scrape type for LU41088: 0
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: WV29949
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: XT85260
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: EA68503
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-03-28 09:07:42 [auto1.it] INFO: Scrape type for EA68503: 0
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: TK21590
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: LV91282
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV91282%27 HTTP/1.1" 200 None
2026-03-28 09:07:42 [auto1.it] INFO: Scrape type for LV91282: 0
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: WC44789
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: NF30981
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF30981%27 HTTP/1.1" 200 None
2026-03-28 09:07:42 [auto1.it] INFO: Scrape type for NF30981: 0
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: UV29542
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV29542%27 HTTP/1.1" 200 None
2026-03-28 09:07:42 [auto1.it] INFO: Scrape type for UV29542: 0
2026-03-28 09:07:42 [auto1.it] INFO: Found listing with ID: EE95145
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE95145%27 HTTP/1.1" 200 None
2026-03-28 09:07:42 [auto1.it] INFO: Scrape type for EE95145: 2
2026-03-28 09:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc6129fc-add5-50e5-8d07-9180edde03fe with identifier: EE95145
2026-03-28 09:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc6129fc-add5-50e5-8d07-9180edde03fe with scrape type 2
2026-03-28 09:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc6129fc-add5-50e5-8d07-9180edde03fe with scrape type 2
2026-03-28 09:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cc6129fc-add5-50e5-8d07-9180edde03fe, identifier: EE95145
2026-03-28 09:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cc6129fc-add5-50e5-8d07-9180edde03fe with identifier: EE95145
2026-03-28 09:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cc6129fc-add5-50e5-8d07-9180edde03fe with identifier: EE95145
2026-03-28 09:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cc6129fc-add5-50e5-8d07-9180edde03fe with identifier: EE95145 to the API
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:42:20Z',
 'fuel_type': 'diesel',
 'id': 'cc6129fc-add5-50e5-8d07-9180edde03fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE95145',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 163178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-20',
 'seller_name': None,
 'title': 'Audi Q3 40 TDI quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2018}
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE95145%27 HTTP/1.1" 200 None
2026-03-28 09:07:43 [auto1.it] INFO: Saving data for EE95145: {'auction_closing_time': 1774716140.0, 'created_time': 1773695288.515218, 'last_price_update_time': 1774688863.444065}
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE95145') HTTP/1.1" 204 0
2026-03-28 09:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:43 [auto1.it] INFO: Found listing with ID: BD71903
2026-03-28 09:07:43 [auto1.it] INFO: Found listing with ID: AY66790
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY66790%27 HTTP/1.1" 200 None
2026-03-28 09:07:43 [auto1.it] INFO: Scrape type for AY66790: 0
2026-03-28 09:07:43 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF08896%27 HTTP/1.1" 200 None
2026-03-28 09:07:43 [auto1.it] INFO: Scrape type for NF08896: 0
2026-03-28 09:07:43 [auto1.it] INFO: Found listing with ID: SS87934
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS87934%27 HTTP/1.1" 200 None
2026-03-28 09:07:43 [auto1.it] INFO: Scrape type for SS87934: 0
2026-03-28 09:07:43 [auto1.it] INFO: Found listing with ID: HP55152
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP55152%27 HTTP/1.1" 200 None
2026-03-28 09:07:43 [auto1.it] INFO: Scrape type for HP55152: 2
2026-03-28 09:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af7b0f65-3966-5f50-8fd6-0760432bcef5 with identifier: HP55152
2026-03-28 09:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af7b0f65-3966-5f50-8fd6-0760432bcef5 with scrape type 2
2026-03-28 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af7b0f65-3966-5f50-8fd6-0760432bcef5 with scrape type 2
2026-03-28 09:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af7b0f65-3966-5f50-8fd6-0760432bcef5, identifier: HP55152
2026-03-28 09:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af7b0f65-3966-5f50-8fd6-0760432bcef5 with identifier: HP55152
2026-03-28 09:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af7b0f65-3966-5f50-8fd6-0760432bcef5 with identifier: HP55152
2026-03-28 09:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af7b0f65-3966-5f50-8fd6-0760432bcef5 with identifier: HP55152 to the API
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:32:23Z',
 'fuel_type': 'petrol',
 'id': 'af7b0f65-3966-5f50-8fd6-0760432bcef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP55152',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 68658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP55152%27 HTTP/1.1" 200 None
2026-03-28 09:07:43 [auto1.it] INFO: Saving data for HP55152: {'auction_closing_time': 1774715543.0, 'created_time': 1773139604.413277, 'last_price_update_time': 1774688863.986941}
2026-03-28 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP55152') HTTP/1.1" 204 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: JV35295
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: ED24082
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED24082%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for ED24082: 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX67440%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for WX67440: 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: DW12727
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: SE81174
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE81174%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for SE81174: 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: VZ97279
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: BN27649
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: JR54930
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54930%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for JR54930: 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: WL53251
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: DV87281
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV87281%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for DV87281: 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: LP60965
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP60965%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for LP60965: 2
2026-03-28 09:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965
2026-03-28 09:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a with scrape type 2
2026-03-28 09:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a with scrape type 2
2026-03-28 09:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab9fe14e-e6e2-56e8-b104-792b2bcec07a, identifier: LP60965
2026-03-28 09:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965
2026-03-28 09:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965
2026-03-28 09:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965 to the API
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'diesel',
 'id': 'ab9fe14e-e6e2-56e8-b104-792b2bcec07a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP60965',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 149042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2014}
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP60965%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Saving data for LP60965: {'auction_closing_time': 1774716868.0, 'created_time': 1774473176.46679, 'last_price_update_time': 1774688864.508588}
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LP60965') HTTP/1.1" 204 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS74594%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for SS74594: 0
2026-03-28 09:07:44 [auto1.it] INFO: Found listing with ID: GA52227
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA52227%27 HTTP/1.1" 200 None
2026-03-28 09:07:44 [auto1.it] INFO: Scrape type for GA52227: 2
2026-03-28 09:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227
2026-03-28 09:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2961e436-2bac-5c36-b3da-6bbb313319e5 with scrape type 2
2026-03-28 09:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2961e436-2bac-5c36-b3da-6bbb313319e5 with scrape type 2
2026-03-28 09:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2961e436-2bac-5c36-b3da-6bbb313319e5, identifier: GA52227
2026-03-28 09:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227
2026-03-28 09:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227
2026-03-28 09:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227 to the API
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:49Z',
 'fuel_type': 'diesel',
 'id': '2961e436-2bac-5c36-b3da-6bbb313319e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA52227',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 75717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA52227%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Saving data for GA52227: {'auction_closing_time': 1774715509.0, 'created_time': 1774472990.190514, 'last_price_update_time': 1774688865.077081}
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GA52227') HTTP/1.1" 204 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: SE94922
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: KC15841
2026-03-28 09:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:45 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: AL92131
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: SP03533
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: EP94562
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: HP33672
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP33672%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Scrape type for HP33672: 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: PZ35188
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: XK43361
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK43361%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Scrape type for XK43361: 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF46529%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Scrape type for AF46529: 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR37659%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Scrape type for DR37659: 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: RA62003
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX04626%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Scrape type for PX04626: 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: NC94766
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Scrape type for NC94766: 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: TM14031
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: TG82781
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: ES51073
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES51073%27 HTTP/1.1" 200 None
2026-03-28 09:07:45 [auto1.it] INFO: Scrape type for ES51073: 0
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: FT97220
2026-03-28 09:07:45 [auto1.it] INFO: Found listing with ID: WU99232
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU99232%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for WU99232: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: SA50428
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA50428%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for SA50428: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ80566%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for JJ80566: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: WH82404
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: KC02263
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: WX97705
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX97705%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for WX97705: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: GH19384
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH19384%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for GH19384: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR23984%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for NR23984: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: CJ26443
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ26443%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for CJ26443: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC13131%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for EC13131: 2
2026-03-28 09:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131
2026-03-28 09:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd94b4e5-1d05-50bb-baf6-842a238367e5 with scrape type 2
2026-03-28 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd94b4e5-1d05-50bb-baf6-842a238367e5 with scrape type 2
2026-03-28 09:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd94b4e5-1d05-50bb-baf6-842a238367e5, identifier: EC13131
2026-03-28 09:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131
2026-03-28 09:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131
2026-03-28 09:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131 to the API
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:48:34Z',
 'fuel_type': 'petrol',
 'id': 'fd94b4e5-1d05-50bb-baf6-842a238367e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC13131',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 11503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-18',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2023}
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC13131%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Saving data for EC13131: {'auction_closing_time': 1774716514.0, 'created_time': 1773136205.833878, 'last_price_update_time': 1774688866.526325}
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC13131') HTTP/1.1" 204 0
2026-03-28 09:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: YH62584
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH62584%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for YH62584: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: SN06060
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN06060%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for SN06060: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: GR20661
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR20661%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for GR20661: 0
2026-03-28 09:07:46 [auto1.it] INFO: Found listing with ID: YK56738
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK56738%27 HTTP/1.1" 200 None
2026-03-28 09:07:46 [auto1.it] INFO: Scrape type for YK56738: 2
2026-03-28 09:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738
2026-03-28 09:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef89dc6-7e57-514a-b140-9379c49156a5 with scrape type 2
2026-03-28 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cef89dc6-7e57-514a-b140-9379c49156a5 with scrape type 2
2026-03-28 09:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cef89dc6-7e57-514a-b140-9379c49156a5, identifier: YK56738
2026-03-28 09:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738
2026-03-28 09:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738
2026-03-28 09:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738 to the API
2026-03-28 09:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:22:17Z',
 'fuel_type': 'diesel',
 'id': 'cef89dc6-7e57-514a-b140-9379c49156a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK56738',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 106222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK56738%27 HTTP/1.1" 200 None
2026-03-28 09:07:47 [auto1.it] INFO: Saving data for YK56738: {'auction_closing_time': 1774714937.0, 'created_time': 1773997716.786244, 'last_price_update_time': 1774688867.179957}
2026-03-28 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YK56738') HTTP/1.1" 204 0
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: GW87429
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: BH09542
2026-03-28 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH09542%27 HTTP/1.1" 200 None
2026-03-28 09:07:47 [auto1.it] INFO: Scrape type for BH09542: 0
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: NM70552
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: SY55940
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: HU85714
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-28 09:07:47 [auto1.it] INFO: Found listing with ID: ZP79936
2026-03-28 09:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:48 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: NL88933
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL88933%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for NL88933: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: HD78178
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD78178%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for HD78178: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: DE32338
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE32338%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for DE32338: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: AK32072
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK32072%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for AK32072: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: AB09853
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB09853%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for AB09853: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS40086%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for PS40086: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ23148%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for XJ23148: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: FX22483
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: BY60716
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: JR58034
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR58034%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for JR58034: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: AE43427
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: RU31162
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU31162%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for RU31162: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS39586%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for VS39586: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: EA47428
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB86834%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for WB86834: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: NL88332
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: EW60341
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW60341%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for EW60341: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: HG53110
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: XD73151
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD73151%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for XD73151: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: PE73293
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: RN28798
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN28798%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for RN28798: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: XR36551
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: ZX52658
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX52658%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for ZX52658: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17675%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for GT17675: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN72005%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for DN72005: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: UJ09788
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF11851%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for RF11851: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: MG39360
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG39360%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for MG39360: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR73173%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for UR73173: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: SY30215
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY30215%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for SY30215: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: YM70173
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: VE91156
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: GS51961
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP32854%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for JP32854: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR14904%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for BR14904: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN82434%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for DN82434: 0
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: LH79871
2026-03-28 09:07:48 [auto1.it] INFO: Found listing with ID: AA53692
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA53692%27 HTTP/1.1" 200 None
2026-03-28 09:07:48 [auto1.it] INFO: Scrape type for AA53692: 0
2026-03-28 09:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:49 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: XE42433
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE42433%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for XE42433: 0
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ15334%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for GZ15334: 0
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: WJ00117
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: GM47184
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM47184%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for GM47184: 0
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: KY15246
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY15246%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for KY15246: 0
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: FX38353
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: JM07675
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM07675%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for JM07675: 0
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: NF63759
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF63759%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for NF63759: 0
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: BF97905
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF97905%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for BF97905: 0
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: RV18634
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: RP22465
2026-03-28 09:07:49 [auto1.it] INFO: Found listing with ID: MD04022
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD04022%27 HTTP/1.1" 200 None
2026-03-28 09:07:49 [auto1.it] INFO: Scrape type for MD04022: 2
2026-03-28 09:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f71e13f-6e83-519e-961a-97d51688be75 with identifier: MD04022
2026-03-28 09:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f71e13f-6e83-519e-961a-97d51688be75 with scrape type 2
2026-03-28 09:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f71e13f-6e83-519e-961a-97d51688be75 with scrape type 2
2026-03-28 09:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f71e13f-6e83-519e-961a-97d51688be75, identifier: MD04022
2026-03-28 09:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f71e13f-6e83-519e-961a-97d51688be75 with identifier: MD04022
2026-03-28 09:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f71e13f-6e83-519e-961a-97d51688be75 with identifier: MD04022
2026-03-28 09:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f71e13f-6e83-519e-961a-97d51688be75 with identifier: MD04022 to the API
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:11:59Z',
 'fuel_type': 'diesel',
 'id': '7f71e13f-6e83-519e-961a-97d51688be75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD04022',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 34237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium X',
 'transmission': 'automatic',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2022}
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD04022%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Saving data for MD04022: {'auction_closing_time': 1774714319.0, 'created_time': 1773674317.92525, 'last_price_update_time': 1774688870.277264}
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD04022') HTTP/1.1" 204 0
2026-03-28 09:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: RL85068
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL85068%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for RL85068: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: UN95232
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN95232%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for UN95232: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: GM12910
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM12910%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for GM12910: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: UM01016
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM01016%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for UM01016: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: AK10390
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: FU92743
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU92743%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for FU92743: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: NY79703
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY79703%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for NY79703: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: ZR63557
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: YN42952
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN42952%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for YN42952: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: PD49568
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD49568%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for PD49568: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: WM56040
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM56040%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for WM56040: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: TW09366
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW09366%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for TW09366: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: PJ86967
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ86967%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for PJ86967: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: LC98621
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC98621%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for LC98621: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT33776%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for WT33776: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ68446%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for CZ68446: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: BK05178
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK05178%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for BK05178: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: JV05733
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV05733%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for JV05733: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: NX71377
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: EG69855
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG69855%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for EG69855: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: MB21840
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: KF04407
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF04407%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for KF04407: 0
2026-03-28 09:07:50 [auto1.it] INFO: Found listing with ID: NB08226
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB08226%27 HTTP/1.1" 200 None
2026-03-28 09:07:50 [auto1.it] INFO: Scrape type for NB08226: 0
2026-03-28 09:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:51 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: WJ13439
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG79286%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for GG79286: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: LE05558
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE05558%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for LE05558: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: DJ62312
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ62312%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for DJ62312: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: AG53064
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: DH05313
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH05313%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for DH05313: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: NU69507
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: AE94250
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: WH67048
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH32473%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for JH32473: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: CV59380
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV59380%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for CV59380: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: NC77921
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: YE04007
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: NT79390
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP22884%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for FP22884: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: LW86273
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86273%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for LW86273: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: FG09627
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG42211%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for BG42211: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: XB60526
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: JS97263
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS97263%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for JS97263: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: FX24983
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX24983%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for FX24983: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11306%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for VU11306: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: WH96118
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH96118%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for WH96118: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: DB15291
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: CG32909
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: KY33943
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY33943%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for KY33943: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: RY92911
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: CR43850
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM64414%27 HTTP/1.1" 200 None
2026-03-28 09:07:51 [auto1.it] INFO: Scrape type for YM64414: 0
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: VW82283
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: LN22753
2026-03-28 09:07:51 [auto1.it] INFO: Found listing with ID: MH41109
2026-03-28 09:07:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:52 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:52 [auto1.it] INFO: Found listing with ID: VH13695
2026-03-28 09:07:52 [auto1.it] INFO: Found listing with ID: UJ01358
2026-03-28 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ01358%27 HTTP/1.1" 200 None
2026-03-28 09:07:52 [auto1.it] INFO: Scrape type for UJ01358: 0
2026-03-28 09:07:52 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-28 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT98508%27 HTTP/1.1" 200 None
2026-03-28 09:07:52 [auto1.it] INFO: Scrape type for NT98508: 0
2026-03-28 09:07:52 [auto1.it] INFO: Found listing with ID: CW72749
2026-03-28 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW72749%27 HTTP/1.1" 200 None
2026-03-28 09:07:52 [auto1.it] INFO: Scrape type for CW72749: 2
2026-03-28 09:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749
2026-03-28 09:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with scrape type 2
2026-03-28 09:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with scrape type 2
2026-03-28 09:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a, identifier: CW72749
2026-03-28 09:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749
2026-03-28 09:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749
2026-03-28 09:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749 to the API
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:19:48Z',
 'fuel_type': 'diesel',
 'id': 'b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW72749',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 220581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2016}
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW72749%27 HTTP/1.1" 200 None
2026-03-28 09:07:53 [auto1.it] INFO: Saving data for CW72749: {'auction_closing_time': 1774714788.0, 'created_time': 1773695124.958412, 'last_price_update_time': 1774688873.457628}
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW72749') HTTP/1.1" 204 0
2026-03-28 09:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:53 [auto1.it] INFO: Found listing with ID: SP39094
2026-03-28 09:07:53 [auto1.it] INFO: Found listing with ID: TZ83605
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-03-28 09:07:53 [auto1.it] INFO: Scrape type for TZ83605: 0
2026-03-28 09:07:53 [auto1.it] INFO: Found listing with ID: NJ78354
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ78354%27 HTTP/1.1" 200 None
2026-03-28 09:07:53 [auto1.it] INFO: Scrape type for NJ78354: 0
2026-03-28 09:07:53 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-28 09:07:53 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC06734%27 HTTP/1.1" 200 None
2026-03-28 09:07:53 [auto1.it] INFO: Scrape type for VC06734: 0
2026-03-28 09:07:53 [auto1.it] INFO: Found listing with ID: NF56876
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF56876%27 HTTP/1.1" 200 None
2026-03-28 09:07:53 [auto1.it] INFO: Scrape type for NF56876: 2
2026-03-28 09:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22a7ca7b-9699-5b1d-9542-add79c289279 with identifier: NF56876
2026-03-28 09:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a7ca7b-9699-5b1d-9542-add79c289279 with scrape type 2
2026-03-28 09:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22a7ca7b-9699-5b1d-9542-add79c289279 with scrape type 2
2026-03-28 09:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22a7ca7b-9699-5b1d-9542-add79c289279, identifier: NF56876
2026-03-28 09:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22a7ca7b-9699-5b1d-9542-add79c289279 with identifier: NF56876
2026-03-28 09:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22a7ca7b-9699-5b1d-9542-add79c289279 with identifier: NF56876
2026-03-28 09:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22a7ca7b-9699-5b1d-9542-add79c289279 with identifier: NF56876 to the API
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:28Z',
 'fuel_type': 'diesel',
 'id': '22a7ca7b-9699-5b1d-9542-add79c289279',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF56876',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 169666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2015}
2026-03-28 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF56876%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Saving data for NF56876: {'auction_closing_time': 1774715908.0, 'created_time': 1774472865.857087, 'last_price_update_time': 1774688874.004705}
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF56876') HTTP/1.1" 204 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: PK52051
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK52051%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for PK52051: 2
2026-03-28 09:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051
2026-03-28 09:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46482bb-0f75-5d9e-b460-64321017a35d with scrape type 2
2026-03-28 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d46482bb-0f75-5d9e-b460-64321017a35d with scrape type 2
2026-03-28 09:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d46482bb-0f75-5d9e-b460-64321017a35d, identifier: PK52051
2026-03-28 09:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051
2026-03-28 09:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051
2026-03-28 09:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051 to the API
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:29Z',
 'fuel_type': 'diesel',
 'id': 'd46482bb-0f75-5d9e-b460-64321017a35d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK52051',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 196146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2019}
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK52051%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Saving data for PK52051: {'auction_closing_time': 1774715009.0, 'created_time': 1774473137.308306, 'last_price_update_time': 1774688874.442919}
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK52051') HTTP/1.1" 204 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: JM74615
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM74615%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for JM74615: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: RF01908
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF01908%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for RF01908: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: YW19585
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW19585%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for YW19585: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46190%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for YD46190: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: XD91118
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: PW09444
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW09444%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for PW09444: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: WE18403
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE18403%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for WE18403: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: GY98380
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: BK23225
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: FS99230
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS99230%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for FS99230: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: GU51710
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: LC66242
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: CK40026
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF15997%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for GF15997: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: TX43497
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF46608%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for LF46608: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: EW58174
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: BJ54442
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: WG71830
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN39787%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for BN39787: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU47897%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for CU47897: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: PC45346
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: PP79756
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP79756%27 HTTP/1.1" 200 None
2026-03-28 09:07:54 [auto1.it] INFO: Scrape type for PP79756: 0
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: ET18212
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-28 09:07:54 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-28 09:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:55 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:55 [auto1.it] INFO: Found listing with ID: CY67116
2026-03-28 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY67116%27 HTTP/1.1" 200 None
2026-03-28 09:07:55 [auto1.it] INFO: Scrape type for CY67116: 2
2026-03-28 09:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116
2026-03-28 09:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with scrape type 2
2026-03-28 09:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with scrape type 2
2026-03-28 09:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff3ddc79-f5a9-52fa-a7f4-c82c56345913, identifier: CY67116
2026-03-28 09:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116
2026-03-28 09:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116
2026-03-28 09:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116 to the API
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:44Z',
 'fuel_type': 'diesel',
 'id': 'ff3ddc79-f5a9-52fa-a7f4-c82c56345913',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY67116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 49457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY67116%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Saving data for CY67116: {'auction_closing_time': 1774714664.0, 'created_time': 1772655283.366951, 'last_price_update_time': 1774688876.400031}
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CY67116') HTTP/1.1" 204 0
2026-03-28 09:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: GN28871
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: GA27692
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: DR95248
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: BC82783
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC82783%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for BC82783: 0
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: NR20429
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR20429%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for NR20429: 0
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: WK48161
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: NV90062
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: EE16681
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE16681%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for EE16681: 0
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: FR49245
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY75551%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for RY75551: 0
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR71790%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for ZR71790: 0
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: KF98112
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF98112%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for KF98112: 0
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK39914%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for XK39914: 0
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: KA09698
2026-03-28 09:07:56 [auto1.it] INFO: Found listing with ID: UD95493
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD95493%27 HTTP/1.1" 200 None
2026-03-28 09:07:56 [auto1.it] INFO: Scrape type for UD95493: 2
2026-03-28 09:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6cc8907-7fc5-5b12-8bfc-23b6cab772e5 with identifier: UD95493
2026-03-28 09:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6cc8907-7fc5-5b12-8bfc-23b6cab772e5 with scrape type 2
2026-03-28 09:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6cc8907-7fc5-5b12-8bfc-23b6cab772e5 with scrape type 2
2026-03-28 09:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b6cc8907-7fc5-5b12-8bfc-23b6cab772e5, identifier: UD95493
2026-03-28 09:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b6cc8907-7fc5-5b12-8bfc-23b6cab772e5 with identifier: UD95493
2026-03-28 09:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b6cc8907-7fc5-5b12-8bfc-23b6cab772e5 with identifier: UD95493
2026-03-28 09:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b6cc8907-7fc5-5b12-8bfc-23b6cab772e5 with identifier: UD95493 to the API
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:27:06Z',
 'fuel_type': 'diesel',
 'id': 'b6cc8907-7fc5-5b12-8bfc-23b6cab772e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD95493',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 276051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-13',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Business Class 2WD',
 'transmission': 'manual',
 'trim': 'Business Class 2WD',
 'year': 2019}
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD95493%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Saving data for UD95493: {'auction_closing_time': 1774715226.0, 'created_time': 1773268392.715625, 'last_price_update_time': 1774688877.038489}
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD95493') HTTP/1.1" 204 0
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: UB69293
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: DW64097
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW64097%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Scrape type for DW64097: 0
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: AR58542
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: BA49572
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA49572%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Scrape type for BA49572: 2
2026-03-28 09:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c62bd71-961a-5600-a144-8152b478a8c1 with identifier: BA49572
2026-03-28 09:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c62bd71-961a-5600-a144-8152b478a8c1 with scrape type 2
2026-03-28 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c62bd71-961a-5600-a144-8152b478a8c1 with scrape type 2
2026-03-28 09:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c62bd71-961a-5600-a144-8152b478a8c1, identifier: BA49572
2026-03-28 09:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c62bd71-961a-5600-a144-8152b478a8c1 with identifier: BA49572
2026-03-28 09:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c62bd71-961a-5600-a144-8152b478a8c1 with identifier: BA49572
2026-03-28 09:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c62bd71-961a-5600-a144-8152b478a8c1 with identifier: BA49572 to the API
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:33:30Z',
 'fuel_type': 'petrol',
 'id': '6c62bd71-961a-5600-a144-8152b478a8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA49572',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 47254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA49572%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Saving data for BA49572: {'auction_closing_time': 1774715610.0, 'created_time': 1774473136.192082, 'last_price_update_time': 1774688877.552919}
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA49572') HTTP/1.1" 204 0
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: JZ33949
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ33949%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Scrape type for JZ33949: 0
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: HG28302
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: MZ33664
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ33664%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Scrape type for MZ33664: 0
2026-03-28 09:07:57 [auto1.it] INFO: Found listing with ID: DH47051
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH47051%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Scrape type for DH47051: 2
2026-03-28 09:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c12f62a-d381-53bf-9886-e8e8cfdc2c8a with identifier: DH47051
2026-03-28 09:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c12f62a-d381-53bf-9886-e8e8cfdc2c8a with scrape type 2
2026-03-28 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c12f62a-d381-53bf-9886-e8e8cfdc2c8a with scrape type 2
2026-03-28 09:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c12f62a-d381-53bf-9886-e8e8cfdc2c8a, identifier: DH47051
2026-03-28 09:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c12f62a-d381-53bf-9886-e8e8cfdc2c8a with identifier: DH47051
2026-03-28 09:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c12f62a-d381-53bf-9886-e8e8cfdc2c8a with identifier: DH47051
2026-03-28 09:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c12f62a-d381-53bf-9886-e8e8cfdc2c8a with identifier: DH47051 to the API
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 430,
 'expiration_date': '2026-03-28T16:13:30Z',
 'fuel_type': 'petrol',
 'id': '3c12f62a-d381-53bf-9886-e8e8cfdc2c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH47051',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 51684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 TwinTurbo S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2016}
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH47051%27 HTTP/1.1" 200 None
2026-03-28 09:07:57 [auto1.it] INFO: Saving data for DH47051: {'auction_closing_time': 1774714410.0, 'created_time': 1774473202.819421, 'last_price_update_time': 1774688877.992942}
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DH47051') HTTP/1.1" 204 0
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: SV45287
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV45287%27 HTTP/1.1" 200 None
2026-03-28 09:07:58 [auto1.it] INFO: Scrape type for SV45287: 0
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: YR08736
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: JM31879
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM31879%27 HTTP/1.1" 200 None
2026-03-28 09:07:58 [auto1.it] INFO: Scrape type for JM31879: 0
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: BX36809
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: MD72836
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD72836%27 HTTP/1.1" 200 None
2026-03-28 09:07:58 [auto1.it] INFO: Scrape type for MD72836: 0
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: CU10476
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: SJ04841
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: VV36209
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV36209%27 HTTP/1.1" 200 None
2026-03-28 09:07:58 [auto1.it] INFO: Scrape type for VV36209: 0
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: EM88233
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM88233%27 HTTP/1.1" 200 None
2026-03-28 09:07:58 [auto1.it] INFO: Scrape type for EM88233: 0
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: FF42282
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF42282%27 HTTP/1.1" 200 None
2026-03-28 09:07:58 [auto1.it] INFO: Scrape type for FF42282: 0
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: UH38063
2026-03-28 09:07:58 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR49145%27 HTTP/1.1" 200 None
2026-03-28 09:07:58 [auto1.it] INFO: Scrape type for BR49145: 0
2026-03-28 09:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:07:59 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 3441 | hits on page: 40
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: VH95383
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH95383%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for VH95383: 2
2026-03-28 09:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ad72898-8dae-5f8d-a168-683bcd7c8dc1 with identifier: VH95383
2026-03-28 09:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ad72898-8dae-5f8d-a168-683bcd7c8dc1 with scrape type 2
2026-03-28 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ad72898-8dae-5f8d-a168-683bcd7c8dc1 with scrape type 2
2026-03-28 09:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ad72898-8dae-5f8d-a168-683bcd7c8dc1, identifier: VH95383
2026-03-28 09:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ad72898-8dae-5f8d-a168-683bcd7c8dc1 with identifier: VH95383
2026-03-28 09:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ad72898-8dae-5f8d-a168-683bcd7c8dc1 with identifier: VH95383
2026-03-28 09:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ad72898-8dae-5f8d-a168-683bcd7c8dc1 with identifier: VH95383 to the API
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:23:01Z',
 'fuel_type': 'petrol',
 'id': '5ad72898-8dae-5f8d-a168-683bcd7c8dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH95383',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 112828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Comfort ISG 2WD',
 'transmission': 'manual',
 'trim': 'Comfort ISG 2WD',
 'year': 2017}
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH95383%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Saving data for VH95383: {'auction_closing_time': 1774714981.0, 'created_time': 1773241899.667658, 'last_price_update_time': 1774688879.478028}
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH95383') HTTP/1.1" 204 0
2026-03-28 09:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: VB21815
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU32452%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for WU32452: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW78911%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for KW78911: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB01371%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for AB01371: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: CT54414
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: ET28084
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET28084%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for ET28084: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: JS18967
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT61687%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for UT61687: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: KV14402
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV14402%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for KV14402: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV97590%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for KV97590: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF84937%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for PF84937: 0
2026-03-28 09:07:59 [auto1.it] INFO: Found listing with ID: DT23804
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT23804%27 HTTP/1.1" 200 None
2026-03-28 09:07:59 [auto1.it] INFO: Scrape type for DT23804: 2
2026-03-28 09:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec5e111-d70c-55af-bd39-ba99191a1c77 with identifier: DT23804
2026-03-28 09:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec5e111-d70c-55af-bd39-ba99191a1c77 with scrape type 2
2026-03-28 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ec5e111-d70c-55af-bd39-ba99191a1c77 with scrape type 2
2026-03-28 09:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ec5e111-d70c-55af-bd39-ba99191a1c77, identifier: DT23804
2026-03-28 09:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ec5e111-d70c-55af-bd39-ba99191a1c77 with identifier: DT23804
2026-03-28 09:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ec5e111-d70c-55af-bd39-ba99191a1c77 with identifier: DT23804
2026-03-28 09:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ec5e111-d70c-55af-bd39-ba99191a1c77 with identifier: DT23804 to the API
2026-03-28 09:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:06:06Z',
 'fuel_type': 'hybrid',
 'id': '7ec5e111-d70c-55af-bd39-ba99191a1c77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT23804',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-30',
 'odometer': 7976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-25',
 'seller_name': None,
 'title': 'Mazda MX-30 electric drive 125 kW Makoto R-EV',
 'transmission': 'automatic',
 'trim': 'Makoto R-EV',
 'year': 2024}
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT23804%27 HTTP/1.1" 200 None
2026-03-28 09:08:00 [auto1.it] INFO: Saving data for DT23804: {'auction_closing_time': 1774713966.0, 'created_time': 1773237133.680352, 'last_price_update_time': 1774688880.214391}
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT23804') HTTP/1.1" 204 0
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: UE59883
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: ZD91383
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD91383%27 HTTP/1.1" 200 None
2026-03-28 09:08:00 [auto1.it] INFO: Scrape type for ZD91383: 0
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ68086%27 HTTP/1.1" 200 None
2026-03-28 09:08:00 [auto1.it] INFO: Scrape type for PZ68086: 2
2026-03-28 09:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086
2026-03-28 09:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293c8f67-cbcb-5471-954c-d28a33e55668 with scrape type 2
2026-03-28 09:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293c8f67-cbcb-5471-954c-d28a33e55668 with scrape type 2
2026-03-28 09:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 293c8f67-cbcb-5471-954c-d28a33e55668, identifier: PZ68086
2026-03-28 09:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086
2026-03-28 09:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086
2026-03-28 09:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086 to the API
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:58:11Z',
 'fuel_type': 'diesel',
 'id': '293c8f67-cbcb-5471-954c-d28a33e55668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ68086',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 242208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Business-Line',
 'transmission': 'automatic',
 'trim': 'Business-Line',
 'year': 2012}
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ68086%27 HTTP/1.1" 200 None
2026-03-28 09:08:00 [auto1.it] INFO: Saving data for PZ68086: {'auction_closing_time': 1774717091.0, 'created_time': 1773137863.080094, 'last_price_update_time': 1774688880.75645}
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ68086') HTTP/1.1" 204 0
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: ED83032
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11581%27 HTTP/1.1" 200 None
2026-03-28 09:08:00 [auto1.it] INFO: Scrape type for XW11581: 0
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: BS34699
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: FA74836
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB18666%27 HTTP/1.1" 200 None
2026-03-28 09:08:00 [auto1.it] INFO: Scrape type for VB18666: 0
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: YU90984
2026-03-28 09:08:00 [auto1.it] INFO: Found listing with ID: TF40729
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF40729%27 HTTP/1.1" 200 None
2026-03-28 09:08:00 [auto1.it] INFO: Scrape type for TF40729: 2
2026-03-28 09:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b94fee0-4755-51ac-8836-eca5ddd2bdcf with identifier: TF40729
2026-03-28 09:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b94fee0-4755-51ac-8836-eca5ddd2bdcf with scrape type 2
2026-03-28 09:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b94fee0-4755-51ac-8836-eca5ddd2bdcf with scrape type 2
2026-03-28 09:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b94fee0-4755-51ac-8836-eca5ddd2bdcf, identifier: TF40729
2026-03-28 09:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b94fee0-4755-51ac-8836-eca5ddd2bdcf with identifier: TF40729
2026-03-28 09:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b94fee0-4755-51ac-8836-eca5ddd2bdcf with identifier: TF40729
2026-03-28 09:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b94fee0-4755-51ac-8836-eca5ddd2bdcf with identifier: TF40729 to the API
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:46:47Z',
 'fuel_type': 'diesel',
 'id': '7b94fee0-4755-51ac-8836-eca5ddd2bdcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF40729',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Musa',
 'odometer': 72889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-30',
 'seller_name': None,
 'title': 'Lancia Musa 1.3 JTD Oro',
 'transmission': 'manual',
 'trim': 'Oro',
 'year': 2010}
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF40729%27 HTTP/1.1" 200 None
2026-03-28 09:08:01 [auto1.it] INFO: Saving data for TF40729: {'auction_closing_time': 1774716407.0, 'created_time': 1774473191.857506, 'last_price_update_time': 1774688881.227224}
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF40729') HTTP/1.1" 204 0
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: LN63295
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA14696%27 HTTP/1.1" 200 None
2026-03-28 09:08:01 [auto1.it] INFO: Scrape type for DA14696: 0
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: WS98369
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: JW15936
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW15936%27 HTTP/1.1" 200 None
2026-03-28 09:08:01 [auto1.it] INFO: Scrape type for JW15936: 2
2026-03-28 09:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e30a6ac-f10f-50b4-9434-9111cd1ae636 with identifier: JW15936
2026-03-28 09:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e30a6ac-f10f-50b4-9434-9111cd1ae636 with scrape type 2
2026-03-28 09:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e30a6ac-f10f-50b4-9434-9111cd1ae636 with scrape type 2
2026-03-28 09:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e30a6ac-f10f-50b4-9434-9111cd1ae636, identifier: JW15936
2026-03-28 09:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e30a6ac-f10f-50b4-9434-9111cd1ae636 with identifier: JW15936
2026-03-28 09:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e30a6ac-f10f-50b4-9434-9111cd1ae636 with identifier: JW15936
2026-03-28 09:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e30a6ac-f10f-50b4-9434-9111cd1ae636 with identifier: JW15936 to the API
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:33:16Z',
 'fuel_type': 'petrol',
 'id': '2e30a6ac-f10f-50b4-9434-9111cd1ae636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW15936',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 48169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-06',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW15936%27 HTTP/1.1" 200 None
2026-03-28 09:08:01 [auto1.it] INFO: Saving data for JW15936: {'auction_closing_time': 1774715596.0, 'created_time': 1773664820.31324, 'last_price_update_time': 1774688881.762366}
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JW15936') HTTP/1.1" 204 0
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: HG36581
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: BF27617
2026-03-28 09:08:01 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH04610%27 HTTP/1.1" 200 None
2026-03-28 09:08:01 [auto1.it] INFO: Scrape type for FH04610: 0
2026-03-28 09:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:03 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: WU42873
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU42873%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for WU42873: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: HW72110
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW72110%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for HW72110: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: ZF50990
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: LD57265
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for LD57265: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: TA99011
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA99011%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for TA99011: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: KR59858
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: SK65228
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: VS16589
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS16589%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for VS16589: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY64752%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for RY64752: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW75946%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for XW75946: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: ZU45449
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU45449%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for ZU45449: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: WM58215
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM58215%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for WM58215: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP08653%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for ZP08653: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: MT35916
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: XH06429
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH06429%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for XH06429: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: TW76525
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP76510%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for CP76510: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: TB87558
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC19770%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for CC19770: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD51522%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for PD51522: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: VW75885
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: PA11194
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: KT64374
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22192%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for HS22192: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: GU77220
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: KC61332
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC61332%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for KC61332: 2
2026-03-28 09:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332
2026-03-28 09:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with scrape type 2
2026-03-28 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with scrape type 2
2026-03-28 09:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57, identifier: KC61332
2026-03-28 09:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332
2026-03-28 09:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332
2026-03-28 09:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332 to the API
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-28T16:57:12Z',
 'fuel_type': 'diesel',
 'id': '4991ee03-7039-5b9e-984e-fd5ac5fe8b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC61332',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 148847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic Premium Plus',
 'transmission': 'automatic',
 'trim': '4Matic Premium Plus',
 'year': 2020}
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC61332%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Saving data for KC61332: {'auction_closing_time': 1774717032.0, 'created_time': 1773997567.9014, 'last_price_update_time': 1774688883.725612}
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC61332') HTTP/1.1" 204 0
2026-03-28 09:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: VZ02173
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ02173%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for VZ02173: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: GR02262
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR02262%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for GR02262: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ91384%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for LJ91384: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY31858%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for CY31858: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: WM29038
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN45534%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for XN45534: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: LR14245
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: UH68033
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: VN85673
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN85673%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for VN85673: 0
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: RM92926
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: NV20276
2026-03-28 09:08:03 [auto1.it] INFO: Found listing with ID: UX25777
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX25777%27 HTTP/1.1" 200 None
2026-03-28 09:08:03 [auto1.it] INFO: Scrape type for UX25777: 0
2026-03-28 09:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:05 [scrapy.extensions.logstats] INFO: Crawled 177 pages (at 26 pages/min), scraped 142 items (at 49 items/min)
2026-03-28 09:08:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 208MiB
2026-03-28 09:08:05 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: EK30542
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK30542%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for EK30542: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: ME36954
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME36954%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for ME36954: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: FY24285
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS13846%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for JS13846: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: NB30604
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: CS63696
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: HW76597
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW76597%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for HW76597: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: AB32606
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB32606%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for AB32606: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: TM60577
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT36373%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for NT36373: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: YX73536
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH73900%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for YH73900: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: TN90495
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN90495%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for TN90495: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: AX03147
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX03147%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for AX03147: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: BZ92290
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ92290%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for BZ92290: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: PB66725
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB66725%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for PB66725: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: TB34384
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB34384%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for TB34384: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ42614%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for MJ42614: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: RJ57897
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ57897%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for RJ57897: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: BJ81440
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ81440%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for BJ81440: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: AF34826
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF34826%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for AF34826: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: UC76692
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: XX89232
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: PW51230
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: TU80185
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU80185%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for TU80185: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE18489%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for KE18489: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: TN86545
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN86545%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for TN86545: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: SN05333
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: NF06538
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF06538%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for NF06538: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: XD75344
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD75344%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for XD75344: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: WV36491
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR62667%27 HTTP/1.1" 200 None
2026-03-28 09:08:05 [auto1.it] INFO: Scrape type for HR62667: 0
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: NG38983
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-28 09:08:05 [auto1.it] INFO: Found listing with ID: SM92282
2026-03-28 09:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:06 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: LF83969
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: GF32219
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: KW05782
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW05782%27 HTTP/1.1" 200 None
2026-03-28 09:08:06 [auto1.it] INFO: Scrape type for KW05782: 0
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: PV36445
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE16682%27 HTTP/1.1" 200 None
2026-03-28 09:08:06 [auto1.it] INFO: Scrape type for JE16682: 0
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: PY44760
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY44760%27 HTTP/1.1" 200 None
2026-03-28 09:08:06 [auto1.it] INFO: Scrape type for PY44760: 0
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: YA27479
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27479%27 HTTP/1.1" 200 None
2026-03-28 09:08:06 [auto1.it] INFO: Scrape type for YA27479: 0
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: GP83867
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP83867%27 HTTP/1.1" 200 None
2026-03-28 09:08:06 [auto1.it] INFO: Scrape type for GP83867: 0
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: RK56494
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: AS05452
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS05452%27 HTTP/1.1" 200 None
2026-03-28 09:08:06 [auto1.it] INFO: Scrape type for AS05452: 0
2026-03-28 09:08:06 [auto1.it] INFO: Found listing with ID: ES04012
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES04012%27 HTTP/1.1" 200 None
2026-03-28 09:08:06 [auto1.it] INFO: Scrape type for ES04012: 2
2026-03-28 09:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012
2026-03-28 09:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca008a8-9f8f-5835-b5d0-0a34df77beea with scrape type 2
2026-03-28 09:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca008a8-9f8f-5835-b5d0-0a34df77beea with scrape type 2
2026-03-28 09:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2ca008a8-9f8f-5835-b5d0-0a34df77beea, identifier: ES04012
2026-03-28 09:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012
2026-03-28 09:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012
2026-03-28 09:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012 to the API
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:32:09Z',
 'fuel_type': 'diesel',
 'id': '2ca008a8-9f8f-5835-b5d0-0a34df77beea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES04012',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 172683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-27',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.3 JTD Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2014}
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES04012%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Saving data for ES04012: {'auction_closing_time': 1774715529.0, 'created_time': 1774473189.817147, 'last_price_update_time': 1774688887.238355}
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ES04012') HTTP/1.1" 204 0
2026-03-28 09:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: LZ09270
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ09270%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for LZ09270: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: AS39534
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: DL65362
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL65362%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for DL65362: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: EN70026
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: XT78781
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: CZ95838
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ95838%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for CZ95838: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: LZ34680
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ34680%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for LZ34680: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: ZH38248
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ90619%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for DZ90619: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: CE26038
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE26038%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for CE26038: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: NB63581
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: VM26372
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM26372%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for VM26372: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL15395%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for NL15395: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: BG87604
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG87604%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for BG87604: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: LZ35961
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ35961%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for LZ35961: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT66548%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for YT66548: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ05187%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for AZ05187: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: NR87302
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: ML34451
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: KC88593
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC88593%27 HTTP/1.1" 200 None
2026-03-28 09:08:07 [auto1.it] INFO: Scrape type for KC88593: 0
2026-03-28 09:08:07 [auto1.it] INFO: Found listing with ID: JH12834
2026-03-28 09:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:08 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH56050%27 HTTP/1.1" 200 None
2026-03-28 09:08:08 [auto1.it] INFO: Scrape type for UH56050: 0
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: VE88440
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE88440%27 HTTP/1.1" 200 None
2026-03-28 09:08:08 [auto1.it] INFO: Scrape type for VE88440: 0
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: WS26494
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: VK91535
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK91535%27 HTTP/1.1" 200 None
2026-03-28 09:08:08 [auto1.it] INFO: Scrape type for VK91535: 0
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF34891%27 HTTP/1.1" 200 None
2026-03-28 09:08:08 [auto1.it] INFO: Scrape type for BF34891: 0
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: FJ33750
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: XN46207
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN46207%27 HTTP/1.1" 200 None
2026-03-28 09:08:08 [auto1.it] INFO: Scrape type for XN46207: 0
2026-03-28 09:08:08 [auto1.it] INFO: Found listing with ID: NF47535
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF47535%27 HTTP/1.1" 200 None
2026-03-28 09:08:08 [auto1.it] INFO: Scrape type for NF47535: 2
2026-03-28 09:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63da36bf-b620-5b61-a513-4db2faf07421 with identifier: NF47535
2026-03-28 09:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63da36bf-b620-5b61-a513-4db2faf07421 with scrape type 2
2026-03-28 09:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63da36bf-b620-5b61-a513-4db2faf07421 with scrape type 2
2026-03-28 09:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63da36bf-b620-5b61-a513-4db2faf07421, identifier: NF47535
2026-03-28 09:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63da36bf-b620-5b61-a513-4db2faf07421 with identifier: NF47535
2026-03-28 09:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63da36bf-b620-5b61-a513-4db2faf07421 with identifier: NF47535
2026-03-28 09:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63da36bf-b620-5b61-a513-4db2faf07421 with identifier: NF47535 to the API
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-28T16:51:21Z',
 'fuel_type': 'diesel',
 'id': '63da36bf-b620-5b61-a513-4db2faf07421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF47535',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 190599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-27',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2006}
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF47535%27 HTTP/1.1" 200 None
2026-03-28 09:08:08 [auto1.it] INFO: Saving data for NF47535: {'auction_closing_time': 1774716681.0, 'created_time': 1774472995.658961, 'last_price_update_time': 1774688888.973208}
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF47535') HTTP/1.1" 204 0
2026-03-28 09:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: AW83777
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW83777%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for AW83777: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: MN57252
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: KZ82470
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: MW18742
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: FC02474
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: JA78037
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: BN58540
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN58540%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for BN58540: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: FU65166
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU65166%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for FU65166: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: YV43254
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV43254%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for YV43254: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: CE40479
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE40479%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for CE40479: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: WT36822
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN39146%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for HN39146: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: DK95010
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: ZT62923
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT62923%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for ZT62923: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: MV32158
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: RV46359
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: VX22650
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX22650%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for VX22650: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: UV86732
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV86732%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for UV86732: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: LR88611
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR88611%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for LR88611: 2
2026-03-28 09:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c3588a-59eb-5415-831f-badcc876080d with identifier: LR88611
2026-03-28 09:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c3588a-59eb-5415-831f-badcc876080d with scrape type 2
2026-03-28 09:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22c3588a-59eb-5415-831f-badcc876080d with scrape type 2
2026-03-28 09:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22c3588a-59eb-5415-831f-badcc876080d, identifier: LR88611
2026-03-28 09:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22c3588a-59eb-5415-831f-badcc876080d with identifier: LR88611
2026-03-28 09:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22c3588a-59eb-5415-831f-badcc876080d with identifier: LR88611
2026-03-28 09:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22c3588a-59eb-5415-831f-badcc876080d with identifier: LR88611 to the API
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:17:16Z',
 'fuel_type': 'petrol',
 'id': '22c3588a-59eb-5415-831f-badcc876080d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR88611',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 207728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-01',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR88611%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Saving data for LR88611: {'auction_closing_time': 1774714636.0, 'created_time': 1774473133.832852, 'last_price_update_time': 1774688889.651517}
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR88611') HTTP/1.1" 204 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: KC34999
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU56229%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for SU56229: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ79920%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for FJ79920: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: LN35929
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN35929%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for LN35929: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: VS62042
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS62042%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for VS62042: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: VR29883
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR29883%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for VR29883: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS88419%27 HTTP/1.1" 200 None
2026-03-28 09:08:09 [auto1.it] INFO: Scrape type for PS88419: 0
2026-03-28 09:08:09 [auto1.it] INFO: Found listing with ID: HP97671
2026-03-28 09:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:10 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: NP87622
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: UA26994
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA26994%27 HTTP/1.1" 200 None
2026-03-28 09:08:10 [auto1.it] INFO: Scrape type for UA26994: 0
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: AM15207
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: ZP66852
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66852%27 HTTP/1.1" 200 None
2026-03-28 09:08:10 [auto1.it] INFO: Scrape type for ZP66852: 0
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: AJ97294
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ97294%27 HTTP/1.1" 200 None
2026-03-28 09:08:10 [auto1.it] INFO: Scrape type for AJ97294: 0
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: SW80726
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW80726%27 HTTP/1.1" 200 None
2026-03-28 09:08:10 [auto1.it] INFO: Scrape type for SW80726: 0
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: MA64070
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: EM71095
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM71095%27 HTTP/1.1" 200 None
2026-03-28 09:08:10 [auto1.it] INFO: Scrape type for EM71095: 0
2026-03-28 09:08:10 [auto1.it] INFO: Found listing with ID: VS38043
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS38043%27 HTTP/1.1" 200 None
2026-03-28 09:08:10 [auto1.it] INFO: Scrape type for VS38043: 2
2026-03-28 09:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043
2026-03-28 09:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae00b673-b087-51b8-ae4d-69c379cd4c80 with scrape type 2
2026-03-28 09:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae00b673-b087-51b8-ae4d-69c379cd4c80 with scrape type 2
2026-03-28 09:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae00b673-b087-51b8-ae4d-69c379cd4c80, identifier: VS38043
2026-03-28 09:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043
2026-03-28 09:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043
2026-03-28 09:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043 to the API
2026-03-28 09:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:52Z',
 'fuel_type': 'diesel',
 'id': 'ae00b673-b087-51b8-ae4d-69c379cd4c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS38043',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 462954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-30',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI extralang Select',
 'transmission': 'automatic',
 'trim': 'extralang Select',
 'year': 2018}
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS38043%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Saving data for VS38043: {'auction_closing_time': 1774714492.0, 'created_time': 1774473185.2056, 'last_price_update_time': 1774688891.205257}
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VS38043') HTTP/1.1" 204 0
2026-03-28 09:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: JW99626
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: JX77984
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: PA30121
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA30121%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for PA30121: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: HJ68479
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ68479%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for HJ68479: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: GK89586
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: CJ22760
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ22760%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for CJ22760: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: FW39632
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW39632%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for FW39632: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: JA96150
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA96150%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for JA96150: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: VL00110
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL00110%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for VL00110: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: ZT47825
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: MZ40359
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: ZM41579
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM41579%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for ZM41579: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: SA83411
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: PT34479
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: SE61764
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE61764%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for SE61764: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: GT94067
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: YR30940
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR30940%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for YR30940: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: AK38143
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK38143%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for AK38143: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW87652%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for JW87652: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP39083%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for MP39083: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: WA88594
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: AB27161
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB27161%27 HTTP/1.1" 200 None
2026-03-28 09:08:11 [auto1.it] INFO: Scrape type for AB27161: 0
2026-03-28 09:08:11 [auto1.it] INFO: Found listing with ID: NN45257
2026-03-28 09:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:12 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:12 [auto1.it] INFO: Found listing with ID: JV66530
2026-03-28 09:08:12 [auto1.it] INFO: Found listing with ID: JV92399
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV92399%27 HTTP/1.1" 200 None
2026-03-28 09:08:12 [auto1.it] INFO: Scrape type for JV92399: 0
2026-03-28 09:08:12 [auto1.it] INFO: Found listing with ID: FP63529
2026-03-28 09:08:12 [auto1.it] INFO: Found listing with ID: GD26025
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD26025%27 HTTP/1.1" 200 None
2026-03-28 09:08:12 [auto1.it] INFO: Scrape type for GD26025: 2
2026-03-28 09:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025
2026-03-28 09:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07abb00b-1303-5dd6-a8e6-88018d312dce with scrape type 2
2026-03-28 09:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07abb00b-1303-5dd6-a8e6-88018d312dce with scrape type 2
2026-03-28 09:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07abb00b-1303-5dd6-a8e6-88018d312dce, identifier: GD26025
2026-03-28 09:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025
2026-03-28 09:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025
2026-03-28 09:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025 to the API
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:30:40Z',
 'fuel_type': 'petrol',
 'id': '07abb00b-1303-5dd6-a8e6-88018d312dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD26025',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 121904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-19',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD26025%27 HTTP/1.1" 200 None
2026-03-28 09:08:12 [auto1.it] INFO: Saving data for GD26025: {'auction_closing_time': 1774715440.0, 'created_time': 1773236639.328309, 'last_price_update_time': 1774688892.993702}
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD26025') HTTP/1.1" 204 0
2026-03-28 09:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: DG54117
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: LC35627
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: GE96866
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE96866%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for GE96866: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: YT54925
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT54925%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for YT54925: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: RN34673
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN34673%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for RN34673: 2
2026-03-28 09:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673
2026-03-28 09:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209b5af8-615a-527f-a45e-1572fb13a2bf with scrape type 2
2026-03-28 09:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 209b5af8-615a-527f-a45e-1572fb13a2bf with scrape type 2
2026-03-28 09:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 209b5af8-615a-527f-a45e-1572fb13a2bf, identifier: RN34673
2026-03-28 09:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673
2026-03-28 09:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673
2026-03-28 09:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673 to the API
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:43:21Z',
 'fuel_type': 'petrol',
 'id': '209b5af8-615a-527f-a45e-1572fb13a2bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN34673',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 117889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Login',
 'transmission': 'manual',
 'trim': 'Login',
 'year': 2017}
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN34673%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Saving data for RN34673: {'auction_closing_time': 1774716201.0, 'created_time': 1774473093.125255, 'last_price_update_time': 1774688893.521749}
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN34673') HTTP/1.1" 204 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: WB49525
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB49525%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for WB49525: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: CG39914
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH76883%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for PH76883: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: PL46674
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: SJ27084
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT06455%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for XT06455: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: YR22180
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR22180%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for YR22180: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: DU27082
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU27082%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for DU27082: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: AH76679
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: ZS91075
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: GJ69248
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ69248%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for GJ69248: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: RH51266
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: HH67812
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: PD61246
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: AN46141
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: NP19925
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: GP32849
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: RG23044
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG23044%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for RG23044: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: JS86571
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS86571%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for JS86571: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: SW25122
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW25122%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for SW25122: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: EL59293
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL59293%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for EL59293: 0
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: WR52243
2026-03-28 09:08:13 [auto1.it] INFO: Found listing with ID: RX05887
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX05887%27 HTTP/1.1" 200 None
2026-03-28 09:08:13 [auto1.it] INFO: Scrape type for RX05887: 0
2026-03-28 09:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:15 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: NF99780
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: UY31632
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY31632%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for UY31632: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV60834%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for DV60834: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: TB04620
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: FN63794
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN63794%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for FN63794: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: NJ73400
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ73400%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for NJ73400: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: ZB01532
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: LY23963
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: AG78775
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG78775%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for AG78775: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY65620%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for SY65620: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: WK43890
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: WL49427
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL49427%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for WL49427: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: ZN97405
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET23172%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for ET23172: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG33831%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for VG33831: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: MX95744
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: NA15959
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: UZ16276
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: PX43587
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX43587%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for PX43587: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: AL00602
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: UY92824
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY92824%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for UY92824: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: WK45429
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: PR60258
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: SM48224
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM48224%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for SM48224: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: CR59099
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR59099%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for CR59099: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: GL14484
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL14484%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for GL14484: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: WX74031
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47770%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for TE47770: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD82932%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for DD82932: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM50235%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for DM50235: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: MB79295
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB79295%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for MB79295: 0
2026-03-28 09:08:15 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV31826%27 HTTP/1.1" 200 None
2026-03-28 09:08:15 [auto1.it] INFO: Scrape type for CV31826: 0
2026-03-28 09:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:16 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: FJ28833
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ28833%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for FJ28833: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: FL86177
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: MY86461
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: LK58538
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK58538%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for LK58538: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: FW75708
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW75708%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for FW75708: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD10861%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for GD10861: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: AK03087
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK03087%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for AK03087: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR57836%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for YR57836: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: PG69146
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: VY17663
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: PW49149
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW49149%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for PW49149: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: DB80555
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: KL59990
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL59990%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for KL59990: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: UU42512
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: ZY88816
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY88816%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for ZY88816: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: KY93059
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: HR68731
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: ZL23627
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL23627%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for ZL23627: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: GZ48200
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ48200%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for GZ48200: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: ZK34576
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: TA76256
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA76256%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for TA76256: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: BA18808
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX42058%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for HX42058: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: CM62235
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM62235%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for CM62235: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: AL31593
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL31593%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for AL31593: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: FZ80781
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ80781%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for FZ80781: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: EZ33304
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: BG88110
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG88110%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for BG88110: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH73732%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for NH73732: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: WT52400
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: PP13796
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP13796%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for PP13796: 0
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: PE82748
2026-03-28 09:08:16 [auto1.it] INFO: Found listing with ID: RD42515
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD42515%27 HTTP/1.1" 200 None
2026-03-28 09:08:16 [auto1.it] INFO: Scrape type for RD42515: 0
2026-03-28 09:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:17 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:17 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-28 09:08:17 [auto1.it] INFO: Found listing with ID: WK11111
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK11111%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for WK11111: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: NR02013
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR02013%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for NR02013: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: DP25317
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: PV17909
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV17909%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for PV17909: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: ZK68739
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: JV47316
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV47316%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for JV47316: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: VU35787
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU35787%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for VU35787: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: CZ70189
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ70189%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for CZ70189: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: MD89845
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD89845%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for MD89845: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: JY72806
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY72806%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for JY72806: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: WS96553
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: PC30910
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: EG37801
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: CS73145
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS73145%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for CS73145: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: MB91559
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for MB91559: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: JE32624
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32624%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for JE32624: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: JD24635
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD24635%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for JD24635: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: NK12319
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: EV42289
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: FH21751
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH21751%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for FH21751: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: LL47627
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: AK61800
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK61800%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for AK61800: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU99331%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for FU99331: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ09783%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for ZJ09783: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05972%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for GF05972: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: KU92785
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU92785%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for KU92785: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: FD98463
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD98463%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for FD98463: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: UM22430
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: DT48563
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: LN31957
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: XD93142
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD93142%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for XD93142: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13084%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for XJ13084: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: WX11793
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX11793%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for WX11793: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: JF99545
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF99545%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for JF99545: 0
2026-03-28 09:08:18 [auto1.it] INFO: Found listing with ID: ST52943
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST52943%27 HTTP/1.1" 200 None
2026-03-28 09:08:18 [auto1.it] INFO: Scrape type for ST52943: 0
2026-03-28 09:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:19 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: SV47237
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV47237%27 HTTP/1.1" 200 None
2026-03-28 09:08:19 [auto1.it] INFO: Scrape type for SV47237: 0
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: JS59612
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: HU75847
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS52204%27 HTTP/1.1" 200 None
2026-03-28 09:08:19 [auto1.it] INFO: Scrape type for SS52204: 0
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: NF28136
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: AX14141
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM53032%27 HTTP/1.1" 200 None
2026-03-28 09:08:19 [auto1.it] INFO: Scrape type for AM53032: 0
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: MY48140
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY48140%27 HTTP/1.1" 200 None
2026-03-28 09:08:19 [auto1.it] INFO: Scrape type for MY48140: 0
2026-03-28 09:08:19 [auto1.it] INFO: Found listing with ID: MK51639
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK51639%27 HTTP/1.1" 200 None
2026-03-28 09:08:19 [auto1.it] INFO: Scrape type for MK51639: 2
2026-03-28 09:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c727464-6ed5-5406-b123-bbaed6aab522 with identifier: MK51639
2026-03-28 09:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c727464-6ed5-5406-b123-bbaed6aab522 with scrape type 2
2026-03-28 09:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c727464-6ed5-5406-b123-bbaed6aab522 with scrape type 2
2026-03-28 09:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c727464-6ed5-5406-b123-bbaed6aab522, identifier: MK51639
2026-03-28 09:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c727464-6ed5-5406-b123-bbaed6aab522 with identifier: MK51639
2026-03-28 09:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c727464-6ed5-5406-b123-bbaed6aab522 with identifier: MK51639
2026-03-28 09:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c727464-6ed5-5406-b123-bbaed6aab522 with identifier: MK51639 to the API
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:45:59Z',
 'fuel_type': 'diesel',
 'id': '4c727464-6ed5-5406-b123-bbaed6aab522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK51639',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 58450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-19',
 'seller_name': None,
 'title': 'Audi A4 30 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK51639%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Saving data for MK51639: {'auction_closing_time': 1774716359.0, 'created_time': 1774473169.041442, 'last_price_update_time': 1774688900.305444}
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MK51639') HTTP/1.1" 204 0
2026-03-28 09:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP30919%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for TP30919: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: AA66716
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA66716%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for AA66716: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: PZ55071
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ55071%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for PZ55071: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: HX67406
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX67406%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for HX67406: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: LT18779
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT18779%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for LT18779: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: KZ33139
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ33139%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for KZ33139: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG53512%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for PG53512: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: ZB38211
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: GX99306
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX18897%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for DX18897: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: DA44533
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44533%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for DA44533: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: YW84907
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW84907%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for YW84907: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: TZ66413
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ66413%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for TZ66413: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: HE47711
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE47711%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for HE47711: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: WD11743
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD11743%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for WD11743: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: AE90071
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE90071%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for AE90071: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: YJ19643
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: TH56934
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH56934%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for TH56934: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: NE50995
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: AU71506
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU71506%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for AU71506: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: NX21307
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: KW35256
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW35256%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for KW35256: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: DL15591
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: SF57726
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: YZ06179
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ06179%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for YZ06179: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: TU42208
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU42208%27 HTTP/1.1" 200 None
2026-03-28 09:08:20 [auto1.it] INFO: Scrape type for TU42208: 0
2026-03-28 09:08:20 [auto1.it] INFO: Found listing with ID: KJ92535
2026-03-28 09:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:21 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 3441 | hits on page: 40
2026-03-28 09:08:21 [auto1.it] INFO: Found listing with ID: KV45254
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV45254%27 HTTP/1.1" 200 None
2026-03-28 09:08:21 [auto1.it] INFO: Scrape type for KV45254: 0
2026-03-28 09:08:21 [auto1.it] INFO: Found listing with ID: FU36287
2026-03-28 09:08:21 [auto1.it] INFO: Found listing with ID: WL38186
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL38186%27 HTTP/1.1" 200 None
2026-03-28 09:08:21 [auto1.it] INFO: Scrape type for WL38186: 0
2026-03-28 09:08:21 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99269%27 HTTP/1.1" 200 None
2026-03-28 09:08:21 [auto1.it] INFO: Scrape type for HW99269: 0
2026-03-28 09:08:21 [auto1.it] INFO: Found listing with ID: WS00889
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS00889%27 HTTP/1.1" 200 None
2026-03-28 09:08:21 [auto1.it] INFO: Scrape type for WS00889: 0
2026-03-28 09:08:21 [auto1.it] INFO: Found listing with ID: RK73921
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK73921%27 HTTP/1.1" 200 None
2026-03-28 09:08:21 [auto1.it] INFO: Scrape type for RK73921: 2
2026-03-28 09:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bd640a2-c8d3-5582-b6d2-c132b6ff13f8 with identifier: RK73921
2026-03-28 09:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bd640a2-c8d3-5582-b6d2-c132b6ff13f8 with scrape type 2
2026-03-28 09:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bd640a2-c8d3-5582-b6d2-c132b6ff13f8 with scrape type 2
2026-03-28 09:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bd640a2-c8d3-5582-b6d2-c132b6ff13f8, identifier: RK73921
2026-03-28 09:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bd640a2-c8d3-5582-b6d2-c132b6ff13f8 with identifier: RK73921
2026-03-28 09:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bd640a2-c8d3-5582-b6d2-c132b6ff13f8 with identifier: RK73921
2026-03-28 09:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bd640a2-c8d3-5582-b6d2-c132b6ff13f8 with identifier: RK73921 to the API
2026-03-28 09:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:36:45Z',
 'fuel_type': 'diesel',
 'id': '4bd640a2-c8d3-5582-b6d2-c132b6ff13f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK73921',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 102598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2022}
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK73921%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Saving data for RK73921: {'auction_closing_time': 1774715805.0, 'created_time': 1774473131.643047, 'last_price_update_time': 1774688902.122395}
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK73921') HTTP/1.1" 204 0
2026-03-28 09:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: HC70741
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC70741%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for HC70741: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: YY30219
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY30219%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for YY30219: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: TD76554
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD76554%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for TD76554: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: VM87489
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: AC54661
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC54661%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for AC54661: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: PP18921
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP18921%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for PP18921: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: PV19108
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV19108%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for PV19108: 2
2026-03-28 09:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108
2026-03-28 09:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d169419-8d7e-5c09-88da-ba121e6bfc90 with scrape type 2
2026-03-28 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d169419-8d7e-5c09-88da-ba121e6bfc90 with scrape type 2
2026-03-28 09:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d169419-8d7e-5c09-88da-ba121e6bfc90, identifier: PV19108
2026-03-28 09:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108
2026-03-28 09:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108
2026-03-28 09:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108 to the API
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:37:34Z',
 'fuel_type': 'petrol',
 'id': '8d169419-8d7e-5c09-88da-ba121e6bfc90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV19108',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 99802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV19108%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Saving data for PV19108: {'auction_closing_time': 1774715854.0, 'created_time': 1773231654.535857, 'last_price_update_time': 1774688902.757359}
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV19108') HTTP/1.1" 204 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: FF63562
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: CB62098
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB62098%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for CB62098: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: FT78551
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: SD84714
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD84714%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for SD84714: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: KE13415
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: TZ72536
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: YA96146
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: SH06277
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH06277%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for SH06277: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: UR19142
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR19142%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for UR19142: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: WK82863
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: XJ75320
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: JU95085
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: VE89845
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE89845%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for VE89845: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: RJ89863
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: US42109
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: JL30882
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: DC69304
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: JE58875
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE58875%27 HTTP/1.1" 200 None
2026-03-28 09:08:22 [auto1.it] INFO: Scrape type for JE58875: 0
2026-03-28 09:08:22 [auto1.it] INFO: Found listing with ID: GC49019
2026-03-28 09:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:23 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: GC49019
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: ZJ87043
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ87043%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for ZJ87043: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: BZ19379
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ19379%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for BZ19379: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: MG94028
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG94028%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for MG94028: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: NG57771
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG57771%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for NG57771: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: LT57228
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT57228%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for LT57228: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: CF86558
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF86558%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for CF86558: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: JN49587
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN49587%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for JN49587: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: PG13965
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: NL47700
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL47700%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for NL47700: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: JU28739
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU28739%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for JU28739: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: YW38439
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT67877%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for ZT67877: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: HT64034
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: RV54155
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV54155%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for RV54155: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: FH96840
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: EF61328
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK09197%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for JK09197: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: YE07599
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE07599%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for YE07599: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: WH56731
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH56731%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for WH56731: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: ST27095
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: LA78712
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA78712%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for LA78712: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: FA49150
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: BG04687
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG04687%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for BG04687: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: TJ80617
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN49105%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for SN49105: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: SK14741
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: VB21565
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: LC83851
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC83851%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for LC83851: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: BF03826
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF03826%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for BF03826: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: CT12062
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT12062%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for CT12062: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: WH54468
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: LK23524
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK23524%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for LK23524: 0
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: WS49358
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-28 09:08:24 [auto1.it] INFO: Found listing with ID: FB83790
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB83790%27 HTTP/1.1" 200 None
2026-03-28 09:08:24 [auto1.it] INFO: Scrape type for FB83790: 0
2026-03-28 09:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:25 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: FP39081
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: KC49805
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC49805%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for KC49805: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: DU03202
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU03202%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for DU03202: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: HK89247
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK89247%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for HK89247: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: CW79165
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: JE99705
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: LU55329
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: YD85432
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: SP63067
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: KJ50164
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ50164%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for KJ50164: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: VU48365
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU48365%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for VU48365: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: RS99601
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS43445%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for HS43445: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: KL91026
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL91026%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for KL91026: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: KP30696
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: LL54959
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: MX03417
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY79670%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for HY79670: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: TR00137
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: WU76177
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU76177%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for WU76177: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: DF56056
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: YV46524
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: GJ72408
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: ZR61375
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16147%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for GT16147: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: EL74502
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: ZB49687
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB49687%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for ZB49687: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: HH94865
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH94865%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for HH94865: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT71441%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for PT71441: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: XX06910
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX06910%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for XX06910: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: ZN78264
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN78264%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for ZN78264: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: HS52325
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS52325%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for HS52325: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: HL91811
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: FS39333
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS39333%27 HTTP/1.1" 200 None
2026-03-28 09:08:25 [auto1.it] INFO: Scrape type for FS39333: 0
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: NT76067
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-28 09:08:25 [auto1.it] INFO: Found listing with ID: TU90316
2026-03-28 09:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:26 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: CF98226
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: PZ28359
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: TY75037
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY75037%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for TY75037: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: HY43750
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: HZ77474
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN35413%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for TN35413: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD77242%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for KD77242: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: UD21419
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD21419%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for UD21419: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: MD54154
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD54154%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for MD54154: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: DS64702
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU70753%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for RU70753: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: FB74710
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB74710%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for FB74710: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: FB96198
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: NN66692
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN66692%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for NN66692: 0
2026-03-28 09:08:26 [auto1.it] INFO: Found listing with ID: YS70370
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS70370%27 HTTP/1.1" 200 None
2026-03-28 09:08:26 [auto1.it] INFO: Scrape type for YS70370: 2
2026-03-28 09:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: babf902f-f58d-5f4b-8d06-904f8461288d with identifier: YS70370
2026-03-28 09:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item babf902f-f58d-5f4b-8d06-904f8461288d with scrape type 2
2026-03-28 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item babf902f-f58d-5f4b-8d06-904f8461288d with scrape type 2
2026-03-28 09:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: babf902f-f58d-5f4b-8d06-904f8461288d, identifier: YS70370
2026-03-28 09:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: babf902f-f58d-5f4b-8d06-904f8461288d with identifier: YS70370
2026-03-28 09:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: babf902f-f58d-5f4b-8d06-904f8461288d with identifier: YS70370
2026-03-28 09:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: babf902f-f58d-5f4b-8d06-904f8461288d with identifier: YS70370 to the API
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:48:29Z',
 'fuel_type': 'petrol',
 'id': 'babf902f-f58d-5f4b-8d06-904f8461288d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS70370',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 92602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS70370%27 HTTP/1.1" 200 None
2026-03-28 09:08:27 [auto1.it] INFO: Saving data for YS70370: {'auction_closing_time': 1774716509.0, 'created_time': 1774386759.84649, 'last_price_update_time': 1774688907.661189}
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YS70370') HTTP/1.1" 204 0
2026-03-28 09:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: MR40406
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR40406%27 HTTP/1.1" 200 None
2026-03-28 09:08:27 [auto1.it] INFO: Scrape type for MR40406: 0
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: WA35829
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA35829%27 HTTP/1.1" 200 None
2026-03-28 09:08:27 [auto1.it] INFO: Scrape type for WA35829: 0
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: HF95426
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF95426%27 HTTP/1.1" 200 None
2026-03-28 09:08:27 [auto1.it] INFO: Scrape type for HF95426: 0
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: FB12726
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: YT69462
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT69462%27 HTTP/1.1" 200 None
2026-03-28 09:08:27 [auto1.it] INFO: Scrape type for YT69462: 0
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: UU91583
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU91583%27 HTTP/1.1" 200 None
2026-03-28 09:08:27 [auto1.it] INFO: Scrape type for UU91583: 0
2026-03-28 09:08:27 [auto1.it] INFO: Found listing with ID: XU63603
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU63603%27 HTTP/1.1" 200 None
2026-03-28 09:08:27 [auto1.it] INFO: Scrape type for XU63603: 2
2026-03-28 09:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 551d2452-ee6a-54e7-84fb-b9ee9c15745c with identifier: XU63603
2026-03-28 09:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551d2452-ee6a-54e7-84fb-b9ee9c15745c with scrape type 2
2026-03-28 09:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 551d2452-ee6a-54e7-84fb-b9ee9c15745c with scrape type 2
2026-03-28 09:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 551d2452-ee6a-54e7-84fb-b9ee9c15745c, identifier: XU63603
2026-03-28 09:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 551d2452-ee6a-54e7-84fb-b9ee9c15745c with identifier: XU63603
2026-03-28 09:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 551d2452-ee6a-54e7-84fb-b9ee9c15745c with identifier: XU63603
2026-03-28 09:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 551d2452-ee6a-54e7-84fb-b9ee9c15745c with identifier: XU63603 to the API
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:25:10Z',
 'fuel_type': 'gas',
 'id': '551d2452-ee6a-54e7-84fb-b9ee9c15745c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU63603',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 159917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 GPL Silver',
 'transmission': 'manual',
 'trim': 'Silver',
 'year': 2016}
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU63603%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Saving data for XU63603: {'auction_closing_time': 1774715110.0, 'created_time': 1774473013.035285, 'last_price_update_time': 1774688908.30073}
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU63603') HTTP/1.1" 204 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: EK49781
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: MT13401
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT13401%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Scrape type for MT13401: 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: YT05499
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR58855%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Scrape type for ZR58855: 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: VV47439
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: NF80846
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF80846%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Scrape type for NF80846: 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: SJ84275
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: HY53959
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: ME40395
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME40395%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Scrape type for ME40395: 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: WB22440
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB22440%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Scrape type for WB22440: 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: ZU26854
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: JJ73686
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: ZZ72466
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ93737%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Scrape type for PZ93737: 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: EU94181
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU94181%27 HTTP/1.1" 200 None
2026-03-28 09:08:28 [auto1.it] INFO: Scrape type for EU94181: 0
2026-03-28 09:08:28 [auto1.it] INFO: Found listing with ID: MP71804
2026-03-28 09:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:29 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:29 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-28 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM11321%27 HTTP/1.1" 200 None
2026-03-28 09:08:29 [auto1.it] INFO: Scrape type for VM11321: 0
2026-03-28 09:08:29 [auto1.it] INFO: Found listing with ID: SC36800
2026-03-28 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC36800%27 HTTP/1.1" 200 None
2026-03-28 09:08:29 [auto1.it] INFO: Scrape type for SC36800: 0
2026-03-28 09:08:29 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-28 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR97776%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for JR97776: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: TD68261
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BX49691
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX49691%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for BX49691: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: RZ83260
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ83260%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for RZ83260: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: XW05686
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW05686%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for XW05686: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: XW18282
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW18282%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for XW18282: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: TZ10866
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: KZ85828
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ85828%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for KZ85828: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BN48518
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: UV86108
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV86108%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for UV86108: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM97748%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for RM97748: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BG14963
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG14963%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for BG14963: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: KF47739
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF47739%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for KF47739: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: KD47428
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD47428%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for KD47428: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: MN95731
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN95731%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for MN95731: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BV54558
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV54558%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for BV54558: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: ZD60941
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BL12911
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: NE73775
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: UG81579
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG81579%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for UG81579: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: ZD82029
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD82029%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for ZD82029: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: NE01926
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE01926%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for NE01926: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: PM63773
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: YS46999
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: DF59331
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF59331%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for DF59331: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: PB31965
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB31965%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for PB31965: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BU54586
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU54586%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for BU54586: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA22905%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for YA22905: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: XC67854
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC67854%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for XC67854: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: HT94696
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV20949%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for LV20949: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: JM05776
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: RB00475
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB00475%27 HTTP/1.1" 200 None
2026-03-28 09:08:30 [auto1.it] INFO: Scrape type for RB00475: 0
2026-03-28 09:08:30 [auto1.it] INFO: Found listing with ID: BL94999
2026-03-28 09:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:32 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: NL09316
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL09316%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for NL09316: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK94629%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for TK94629: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: TD66065
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: KU78765
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU78765%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for KU78765: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: SC05628
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05628%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for SC05628: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: AS40947
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: JK70304
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: ZJ10623
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: AY88271
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: FA14531
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: VX65874
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX65874%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for VX65874: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: LY05485
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY05485%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for LY05485: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: UT39332
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: RN93859
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN93859%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for RN93859: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: YV65594
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV65594%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for YV65594: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB50671%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for MB50671: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: HB16965
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: LN12916
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN12916%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for LN12916: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: CT16450
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT16450%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for CT16450: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: NT40514
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM68683%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for YM68683: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: RS48404
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: FN49181
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: LA93311
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: CL54955
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: KY00124
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY00124%27 HTTP/1.1" 200 None
2026-03-28 09:08:32 [auto1.it] INFO: Scrape type for KY00124: 0
2026-03-28 09:08:32 [auto1.it] INFO: Found listing with ID: MW20525
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW20525%27 HTTP/1.1" 200 None
2026-03-28 09:08:33 [auto1.it] INFO: Scrape type for MW20525: 0
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: FM16184
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: BY67467
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: ST73163
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST73163%27 HTTP/1.1" 200 None
2026-03-28 09:08:33 [auto1.it] INFO: Scrape type for ST73163: 0
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: DV99228
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: UZ46554
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: KM32276
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: KF21230
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF21230%27 HTTP/1.1" 200 None
2026-03-28 09:08:33 [auto1.it] INFO: Scrape type for KF21230: 2
2026-03-28 09:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 575a8b4b-c4dc-521f-a0ac-acb489d3865c with identifier: KF21230
2026-03-28 09:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575a8b4b-c4dc-521f-a0ac-acb489d3865c with scrape type 2
2026-03-28 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 575a8b4b-c4dc-521f-a0ac-acb489d3865c with scrape type 2
2026-03-28 09:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 575a8b4b-c4dc-521f-a0ac-acb489d3865c, identifier: KF21230
2026-03-28 09:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 575a8b4b-c4dc-521f-a0ac-acb489d3865c with identifier: KF21230
2026-03-28 09:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 575a8b4b-c4dc-521f-a0ac-acb489d3865c with identifier: KF21230
2026-03-28 09:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 575a8b4b-c4dc-521f-a0ac-acb489d3865c with identifier: KF21230 to the API
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:08Z',
 'fuel_type': 'diesel',
 'id': '575a8b4b-c4dc-521f-a0ac-acb489d3865c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF21230',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 194871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-16',
 'seller_name': None,
 'title': 'Nissan Micra 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF21230%27 HTTP/1.1" 200 None
2026-03-28 09:08:33 [auto1.it] INFO: Saving data for KF21230: {'auction_closing_time': 1774714988.0, 'created_time': 1773233319.597788, 'last_price_update_time': 1774688913.710527}
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KF21230') HTTP/1.1" 204 0
2026-03-28 09:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: KJ44926
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ44926%27 HTTP/1.1" 200 None
2026-03-28 09:08:33 [auto1.it] INFO: Scrape type for KJ44926: 0
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: KE56728
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE56728%27 HTTP/1.1" 200 None
2026-03-28 09:08:33 [auto1.it] INFO: Scrape type for KE56728: 0
2026-03-28 09:08:33 [auto1.it] INFO: Found listing with ID: JN46164
2026-03-28 09:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:34 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: DJ11873
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: UH02752
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH02752%27 HTTP/1.1" 200 None
2026-03-28 09:08:34 [auto1.it] INFO: Scrape type for UH02752: 0
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: TA27022
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: EE25529
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE25529%27 HTTP/1.1" 200 None
2026-03-28 09:08:34 [auto1.it] INFO: Scrape type for EE25529: 0
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: AK59444
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: MR66716
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA42280%27 HTTP/1.1" 200 None
2026-03-28 09:08:34 [auto1.it] INFO: Scrape type for PA42280: 0
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: GW20648
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: JR22558
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR22558%27 HTTP/1.1" 200 None
2026-03-28 09:08:34 [auto1.it] INFO: Scrape type for JR22558: 0
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: NZ11107
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ11107%27 HTTP/1.1" 200 None
2026-03-28 09:08:34 [auto1.it] INFO: Scrape type for NZ11107: 0
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN42286%27 HTTP/1.1" 200 None
2026-03-28 09:08:34 [auto1.it] INFO: Scrape type for WN42286: 0
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: KM60643
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: LA47308
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA47308%27 HTTP/1.1" 200 None
2026-03-28 09:08:34 [auto1.it] INFO: Scrape type for LA47308: 0
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: WG64225
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: FM38716
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-28 09:08:34 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC01017%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for LC01017: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: MV39692
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: DA96064
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA96064%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for DA96064: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: NJ11800
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: CD95874
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: DT73051
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT73051%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for DT73051: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: PK63277
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK85417%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for FK85417: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF37027%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for TF37027: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: UU36082
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU36082%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for UU36082: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: NS61318
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: WA05631
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05631%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for WA05631: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: SR34135
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR34135%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for SR34135: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC99456%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for PC99456: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: PF34434
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: UY73261
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: DM22709
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM22709%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for DM22709: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: FC30574
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: ND56106
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND56106%27 HTTP/1.1" 200 None
2026-03-28 09:08:35 [auto1.it] INFO: Scrape type for ND56106: 0
2026-03-28 09:08:35 [auto1.it] INFO: Found listing with ID: JC04494
2026-03-28 09:08:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:36 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: LC40122
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: SU89902
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU89902%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for SU89902: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: VD81489
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD81489%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for VD81489: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: AY85424
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY85424%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for AY85424: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: MF53034
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: AU72091
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: EZ36845
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ36845%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for EZ36845: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: FR71474
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: NR76329
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: EV83401
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: DJ42894
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: TM24531
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: CW41374
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: UW33297
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW33297%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for UW33297: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: JJ70536
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: WC74031
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: FH60242
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: HJ29626
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ29626%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for HJ29626: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: ZN12664
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN12664%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for ZN12664: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: TW11966
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW11966%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for TW11966: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: FL85946
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL85946%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for FL85946: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: VJ53947
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: RW18979
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW18979%27 HTTP/1.1" 200 None
2026-03-28 09:08:36 [auto1.it] INFO: Scrape type for RW18979: 0
2026-03-28 09:08:36 [auto1.it] INFO: Found listing with ID: YF61167
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF61167%27 HTTP/1.1" 200 None
2026-03-28 09:08:37 [auto1.it] INFO: Scrape type for YF61167: 0
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: GJ41533
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: PK33563
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: WG29768
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: EA21058
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA21058%27 HTTP/1.1" 200 None
2026-03-28 09:08:37 [auto1.it] INFO: Scrape type for EA21058: 0
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: VX99971
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX99971%27 HTTP/1.1" 200 None
2026-03-28 09:08:37 [auto1.it] INFO: Scrape type for VX99971: 0
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: BP79618
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: WG71791
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG71791%27 HTTP/1.1" 200 None
2026-03-28 09:08:37 [auto1.it] INFO: Scrape type for WG71791: 0
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY63215%27 HTTP/1.1" 200 None
2026-03-28 09:08:37 [auto1.it] INFO: Scrape type for ZY63215: 0
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: EH99264
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: LB86726
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: XN70596
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: PZ92590
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ92590%27 HTTP/1.1" 200 None
2026-03-28 09:08:37 [auto1.it] INFO: Scrape type for PZ92590: 0
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: CM44345
2026-03-28 09:08:37 [auto1.it] INFO: Found listing with ID: YW27369
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW27369%27 HTTP/1.1" 200 None
2026-03-28 09:08:37 [auto1.it] INFO: Scrape type for YW27369: 0
2026-03-28 09:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:39 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: SH22668
2026-03-28 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22668%27 HTTP/1.1" 200 None
2026-03-28 09:08:39 [auto1.it] INFO: Scrape type for SH22668: 0
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: PU31383
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: VR30636
2026-03-28 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR30636%27 HTTP/1.1" 200 None
2026-03-28 09:08:39 [auto1.it] INFO: Scrape type for VR30636: 0
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: CK65162
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: AP21705
2026-03-28 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP21705%27 HTTP/1.1" 200 None
2026-03-28 09:08:39 [auto1.it] INFO: Scrape type for AP21705: 0
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: VH38350
2026-03-28 09:08:39 [auto1.it] INFO: Found listing with ID: XC86223
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC86223%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for XC86223: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY71286%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for NY71286: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF61926%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for CF61926: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL28261%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for SL28261: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ72452%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for XZ72452: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT62115%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for CT62115: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: NA19420
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW61851%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for PW61851: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: FR09226
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR09226%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for FR09226: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: TZ10573
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: LL55379
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL55379%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for LL55379: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: EP71722
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP71722%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for EP71722: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS77350%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for RS77350: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: DT20429
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK63045%27 HTTP/1.1" 200 None
2026-03-28 09:08:40 [auto1.it] INFO: Scrape type for RK63045: 0
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-28 09:08:40 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-28 09:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:41 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: GJ25112
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: CL45076
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: PG35916
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG35916%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for PG35916: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: ZU55509
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU55509%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for ZU55509: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84941%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for EC84941: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: ZN80284
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: ZL81271
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL81271%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for ZL81271: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: RV64842
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: XW64768
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY24745%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for GY24745: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: WG32639
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG32639%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for WG32639: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: KA78119
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA78119%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for KA78119: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT00361%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for KT00361: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: DB99572
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB99572%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for DB99572: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: ZS75876
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS75876%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for ZS75876: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: XR19887
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for XR19887: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: UW96033
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN43339%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for UN43339: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: DM22162
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: VF71012
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: DT03603
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT03603%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for DT03603: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: AN46326
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: ZT86767
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: CE88274
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE88274%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for CE88274: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: LB78723
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: KB64117
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: HB85992
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: WP02751
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB32662%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for KB32662: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: CM16503
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: CV26562
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for CV26562: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: LV27017
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: PW98934
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW98934%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for PW98934: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: PZ48613
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ48613%27 HTTP/1.1" 200 None
2026-03-28 09:08:41 [auto1.it] INFO: Scrape type for PZ48613: 0
2026-03-28 09:08:41 [auto1.it] INFO: Found listing with ID: MR45258
2026-03-28 09:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:42 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: WG08894
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG08894%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for WG08894: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: HF76476
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF76476%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for HF76476: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: TY18364
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY18364%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for TY18364: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: NV82845
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: PM77932
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77932%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for PM77932: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: GZ60590
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for GZ60590: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: UA61069
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: PB72674
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB72674%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for PB72674: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: GS07587
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS07587%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for GS07587: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: VJ15717
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: FA85590
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA85590%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for FA85590: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: VC28082
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: MA80694
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: JP88345
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: HM97674
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for HM97674: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: UF13738
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for UF13738: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: RP10798
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP10798%27 HTTP/1.1" 200 None
2026-03-28 09:08:42 [auto1.it] INFO: Scrape type for RP10798: 0
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: NK13523
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: BH85641
2026-03-28 09:08:42 [auto1.it] INFO: Found listing with ID: DF73154
2026-03-28 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF73154%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for DF73154: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: JH70368
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH70368%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for JH70368: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: RF82114
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF82114%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for RF82114: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: YS98054
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: TD98171
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: RG82226
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG82226%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for RG82226: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01763%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for HS01763: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: HS85648
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: UC01773
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: ZV58496
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV58496%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for ZV58496: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE54964%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for ZE54964: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: TG01095
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: FG93356
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: LD09745
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: FZ53517
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ53517%27 HTTP/1.1" 200 None
2026-03-28 09:08:43 [auto1.it] INFO: Scrape type for FZ53517: 0
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: ED44758
2026-03-28 09:08:43 [auto1.it] INFO: Found listing with ID: FM26794
2026-03-28 09:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:44 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: MA29879
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: RP11137
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP11137%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for RP11137: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT34353%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for BT34353: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: MV84060
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: XH21917
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: CV60051
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: RM66243
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66243%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for RM66243: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: XF07692
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF07692%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for XF07692: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: FC82856
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC82856%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for FC82856: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: LH93951
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH93951%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for LH93951: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: YL53737
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: NC75436
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC75436%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for NC75436: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: ZZ37301
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ37301%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for ZZ37301: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: ED49512
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED49512%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for ED49512: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP30320%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for PP30320: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: GU13900
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: LX88559
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: DR08334
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR08334%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for DR08334: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: JL50472
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: PA95874
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA95874%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for PA95874: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: KW91343
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: MG56824
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG56824%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for MG56824: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: ZC61191
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: KF16617
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF16617%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for KF16617: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: CF46707
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: PW55510
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: HH63511
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH63511%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for HH63511: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: XB83607
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: TX19342
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: FG48164
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG48164%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for FG48164: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: WD01397
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: PT91804
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT91804%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for PT91804: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: WA90639
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA90639%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for WA90639: 0
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-28 09:08:44 [auto1.it] INFO: Found listing with ID: RW29335
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW29335%27 HTTP/1.1" 200 None
2026-03-28 09:08:44 [auto1.it] INFO: Scrape type for RW29335: 0
2026-03-28 09:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:45 [auto1.it] INFO: Channel: 24h | Page: 58 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: LL12083
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL12083%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for LL12083: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: RV05928
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV05928%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for RV05928: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: TH12767
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for TH12767: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: PM18246
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for PM18246: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: WD56351
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD56351%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for WD56351: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: CC30639
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: HX11977
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX11977%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for HX11977: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: DP76328
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: AW58556
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW58556%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for AW58556: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: PV15987
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV15987%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for PV15987: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: CL12006
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL12006%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for CL12006: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: JF71307
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF71307%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for JF71307: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ84756%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for DZ84756: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS56995%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for MS56995: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: GL66582
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL66582%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for GL66582: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: CY86412
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: UF72432
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY33245%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for MY33245: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: AJ60776
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ60776%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for AJ60776: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: TY10894
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78357%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for XE78357: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: JK74619
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: MP43347
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP43347%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for MP43347: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: PW94321
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: TW74539
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW74539%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for TW74539: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: VA19442
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: TE58119
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE58119%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for TE58119: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: JE47359
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: UN82812
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN82812%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for UN82812: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: NY32354
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: SJ01004
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: LT40503
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT40503%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for LT40503: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: WM11657
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM11657%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for WM11657: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE69721%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for UE69721: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: JM45525
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM45525%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for JM45525: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK41226%27 HTTP/1.1" 200 None
2026-03-28 09:08:45 [auto1.it] INFO: Scrape type for LK41226: 0
2026-03-28 09:08:45 [auto1.it] INFO: Found listing with ID: PY67809
2026-03-28 09:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:46 [auto1.it] INFO: Channel: 24h | Page: 59 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:46 [auto1.it] INFO: Found listing with ID: AR75288
2026-03-28 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-03-28 09:08:46 [auto1.it] INFO: Scrape type for AR75288: 0
2026-03-28 09:08:46 [auto1.it] INFO: Found listing with ID: CC38262
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC38262%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for CC38262: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: MK10556
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: YD65738
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD65738%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for YD65738: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM28799%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for GM28799: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP40750%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for NP40750: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL90232%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for FL90232: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59296%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for TU59296: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: PR98561
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR98561%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for PR98561: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: AY33190
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: AA13192
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA13192%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for AA13192: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: BX20882
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX20882%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for BX20882: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT42979%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for UT42979: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: CV95594
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV95594%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for CV95594: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY77506%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for AY77506: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH49254%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for KH49254: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW10693%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for PW10693: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: DC13549
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: WX66376
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: SY39981
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD08971%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for MD08971: 0
2026-03-28 09:08:47 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW42216%27 HTTP/1.1" 200 None
2026-03-28 09:08:47 [auto1.it] INFO: Scrape type for ZW42216: 0
2026-03-28 09:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:48 [auto1.it] INFO: Channel: 24h | Page: 60 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX71767%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for BX71767: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: GP73012
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: XG67662
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: EJ77874
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: BK28378
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK28378%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for BK28378: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA31078%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for CA31078: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX25254%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for DX25254: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: KD79727
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD79727%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for KD79727: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: GV78603
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV78603%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for GV78603: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD36680%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for JD36680: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB10468%27 HTTP/1.1" 200 None
2026-03-28 09:08:48 [auto1.it] INFO: Scrape type for HB10468: 0
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: RA38886
2026-03-28 09:08:48 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-28 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH45262%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for EH45262: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: SK02509
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK02509%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for SK02509: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: YX30570
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP88184%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for WP88184: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: ZG90138
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: TM53494
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ06099%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for BZ06099: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: KB16454
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: FE09970
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE09970%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for FE09970: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11641%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for XW11641: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: PK37829
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: LA07616
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA07616%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for LA07616: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ93406%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for VJ93406: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: SG11242
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG11242%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for SG11242: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: ZX94133
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX94133%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for ZX94133: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23835%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for VE23835: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC19416%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for ZC19416: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL31507%27 HTTP/1.1" 200 None
2026-03-28 09:08:49 [auto1.it] INFO: Scrape type for DL31507: 0
2026-03-28 09:08:49 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-28 09:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:50 [auto1.it] INFO: Channel: 24h | Page: 61 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: CW11593
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW16027%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for DW16027: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC12493%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for NC12493: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: GD15248
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD15248%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for GD15248: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ37840%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for RJ37840: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC99785%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for EC99785: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: ZZ86621
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ86621%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for ZZ86621: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: VT42510
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT42510%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for VT42510: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN57194%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for LN57194: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ63395%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for PZ63395: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV58522%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for DV58522: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: GH85070
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH85070%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for GH85070: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: MN32437
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY40178%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for AY40178: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99467%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for GZ99467: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU32516%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for ZU32516: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK76451%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for HK76451: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: VG48139
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG48139%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for VG48139: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: CY33103
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH17825%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for WH17825: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT23346%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for JT23346: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF43689%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for RF43689: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK45797%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for FK45797: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: GW83806
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW83806%27 HTTP/1.1" 200 None
2026-03-28 09:08:50 [auto1.it] INFO: Scrape type for GW83806: 0
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: PH45617
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-28 09:08:50 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-28 09:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:51 [auto1.it] INFO: Channel: 24h | Page: 62 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD38461%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for KD38461: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: XU37749
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18020%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for YG18020: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: HW85888
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW85888%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for HW85888: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA44632%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for HA44632: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE21394%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for ZE21394: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA54300%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for YA54300: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG55667%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for BG55667: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: TN53037
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG42626%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for TG42626: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL94615%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for LL94615: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD47870%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for YD47870: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS41050%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for RS41050: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET57280%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for ET57280: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN44276%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for RN44276: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST06974%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for ST06974: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA93618%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for FA93618: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS43685%27 HTTP/1.1" 200 None
2026-03-28 09:08:51 [auto1.it] INFO: Scrape type for KS43685: 0
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-28 09:08:51 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-28 09:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:53 [auto1.it] INFO: Channel: 24h | Page: 63 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: PP68116
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE79185%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for SE79185: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: TT81235
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF07503%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for JF07503: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: RV62579
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV62579%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for RV62579: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD53627%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for FD53627: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT42722%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for VT42722: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG54549%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for AG54549: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: FR03346
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR03346%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for FR03346: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY39151%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for UY39151: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: SP41813
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP41813%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for SP41813: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM78443%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for VM78443: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: KE11189
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: YB63473
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB63473%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for YB63473: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY46493%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for FY46493: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN74108%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for GN74108: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: GF01079
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF01079%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for GF01079: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: XV16730
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV16730%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for XV16730: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: CH52447
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH52447%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for CH52447: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA89499%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for UA89499: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU80477%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for WU80477: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK06699%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for YK06699: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK87302%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for DK87302: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF27989%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for RF27989: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV99764%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for TV99764: 0
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-28 09:08:53 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD82423%27 HTTP/1.1" 200 None
2026-03-28 09:08:53 [auto1.it] INFO: Scrape type for HD82423: 0
2026-03-28 09:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:54 [auto1.it] INFO: Channel: 24h | Page: 64 | totalHits: 3442 | hits on page: 40
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW60366%27 HTTP/1.1" 200 None
2026-03-28 09:08:54 [auto1.it] INFO: Scrape type for NW60366: 0
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: WV72590
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP20263%27 HTTP/1.1" 200 None
2026-03-28 09:08:54 [auto1.it] INFO: Scrape type for FP20263: 0
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM78801%27 HTTP/1.1" 200 None
2026-03-28 09:08:54 [auto1.it] INFO: Scrape type for WM78801: 0
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR67394%27 HTTP/1.1" 200 None
2026-03-28 09:08:54 [auto1.it] INFO: Scrape type for BR67394: 0
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: KP12391
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-28 09:08:54 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-28 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE55630%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for WE55630: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY35916%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for JY35916: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ49625%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for KZ49625: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA15195%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for BA15195: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN78187%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for FN78187: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU27646%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for RU27646: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN99534%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for DN99534: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN89798%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for FN89798: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55866%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for WH55866: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: DN08813
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH14903%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for YH14903: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78855%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for HC78855: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: GM03670
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM03670%27 HTTP/1.1" 200 None
2026-03-28 09:08:55 [auto1.it] INFO: Scrape type for GM03670: 0
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-28 09:08:55 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-28 09:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:57 [auto1.it] INFO: Channel: 24h | Page: 65 | totalHits: 3443 | hits on page: 40
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD07113%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for PD07113: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN01400%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for PN01400: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: HM54008
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76824%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for SP76824: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM59258%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for KM59258: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: EK35642
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL53946%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for GL53946: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79490%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for DC79490: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES64600%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for ES64600: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80724%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for FL80724: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV13161%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for ZV13161: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX88611%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for WX88611: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX82404%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for DX82404: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: SC24442
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24442%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for SC24442: 0
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-28 09:08:57 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ95408%27 HTTP/1.1" 200 None
2026-03-28 09:08:57 [auto1.it] INFO: Scrape type for HZ95408: 2
2026-03-28 09:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-03-28 09:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6042fe-d933-5d26-ac1a-04138888742a with scrape type 2
2026-03-28 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6042fe-d933-5d26-ac1a-04138888742a with scrape type 2
2026-03-28 09:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb6042fe-d933-5d26-ac1a-04138888742a, identifier: HZ95408
2026-03-28 09:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-03-28 09:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-03-28 09:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408 to the API
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:45:19Z',
 'fuel_type': 'diesel',
 'id': 'bb6042fe-d933-5d26-ac1a-04138888742a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ95408',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 146510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi L1 Sport',
 'transmission': 'automatic',
 'trim': 'L1 Sport',
 'year': 2022}
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ95408%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Saving data for HZ95408: {'auction_closing_time': 1774716319.0, 'created_time': 1774602435.708658, 'last_price_update_time': 1774688938.594594}
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HZ95408') HTTP/1.1" 204 0
2026-03-28 09:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: KT12037
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV86323%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for TV86323: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ76443%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for JJ76443: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW35893%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for YW35893: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: LU63066
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG85699%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for JG85699: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57000%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for HU57000: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG91847%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for HG91847: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: TM20698
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM20698%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for TM20698: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG41149%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for FG41149: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA39708%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for HA39708: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH51436%27 HTTP/1.1" 200 None
2026-03-28 09:08:58 [auto1.it] INFO: Scrape type for FH51436: 0
2026-03-28 09:08:58 [auto1.it] INFO: Found listing with ID: EH34312
2026-03-28 09:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:08:59 [auto1.it] INFO: Channel: 24h | Page: 66 | totalHits: 3443 | hits on page: 40
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR14989%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for AR14989: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC82026%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for YC82026: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD81326%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for XD81326: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: JK90392
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK90392%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for JK90392: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR28136%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for AR28136: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: GN36205
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH69939%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for LH69939: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM72883%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for LM72883: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA21374%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for PA21374: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: BV21704
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: ZC10752
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: DB81041
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB81041%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for DB81041: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: BM64259
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX11958%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for LX11958: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH57446%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for CH57446: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR03634%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for AR03634: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB22303%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for GB22303: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: XX29767
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV71044%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for SV71044: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: EP62214
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP62214%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for EP62214: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31613%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for BR31613: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG91000%27 HTTP/1.1" 200 None
2026-03-28 09:08:59 [auto1.it] INFO: Scrape type for SG91000: 0
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: SV61491
2026-03-28 09:08:59 [auto1.it] INFO: Found listing with ID: VF92770
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92770%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for VF92770: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD83412%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for AD83412: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: RF93024
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF93024%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for RF93024: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70389%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for PW70389: 0
2026-03-28 09:09:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:00 [auto1.it] INFO: Channel: 24h | Page: 67 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD99116%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for YD99116: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF24893%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for HF24893: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE26782%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for VE26782: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: WL14524
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL14524%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for WL14524: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU78491%27 HTTP/1.1" 200 None
2026-03-28 09:09:00 [auto1.it] INFO: Scrape type for AU78491: 0
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-28 09:09:00 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-28 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR58570%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for SR58570: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW38972%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for HW38972: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: YD44226
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD44226%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for YD44226: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX07844%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for RX07844: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC85106%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for XC85106: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX81106%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for GX81106: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: NH13553
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH13553%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for NH13553: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU15371%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for CU15371: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN52557%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for BN52557: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: EA61163
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: HT95885
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT95885%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for HT95885: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: EA76192
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA76192%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for EA76192: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK62879%27 HTTP/1.1" 200 None
2026-03-28 09:09:01 [auto1.it] INFO: Scrape type for HK62879: 0
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-28 09:09:01 [auto1.it] INFO: Found listing with ID: MV48834
2026-03-28 09:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:02 [auto1.it] INFO: Channel: 24h | Page: 68 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: CA37263
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA37263%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for CA37263: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY80184%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for VY80184: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB33793%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for CB33793: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: XV63353
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV63353%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for XV63353: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB12646%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for KB12646: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: PX76093
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX76093%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for PX76093: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY46039%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for YY46039: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: XX32057
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: HM08879
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM08879%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for HM08879: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP35914%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for FP35914: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC53002%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for GC53002: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV19054%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for FV19054: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU49337%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for CU49337: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: DK62006
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK62006%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for DK62006: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: SR32433
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: BA09093
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA09093%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for BA09093: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY97368%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for TY97368: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: GV26258
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV26258%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for GV26258: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: VY84485
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY84485%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for VY84485: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: TE87413
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE87413%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for TE87413: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: UD61425
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61425%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for UD61425: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG67619%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for MG67619: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: VZ32715
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ32715%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for VZ32715: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF86061%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for AF86061: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK70353%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for UK70353: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV49335%27 HTTP/1.1" 200 None
2026-03-28 09:09:02 [auto1.it] INFO: Scrape type for GV49335: 0
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-28 09:09:02 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-28 09:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:04 [auto1.it] INFO: Channel: 24h | Page: 69 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: FR70206
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR70206%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for FR70206: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: UX09906
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX09906%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for UX09906: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: MJ31103
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: HJ18951
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ18951%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for HJ18951: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: YM27608
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM27608%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for YM27608: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: ZF27085
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF78298%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for RF78298: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: VD83585
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: XW70858
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW70858%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for XW70858: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN28374%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for PN28374: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: KE46739
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: JE85806
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS28867%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for LS28867: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91639%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for SC91639: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66107%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for RM66107: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: KH81346
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH81346%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for KH81346: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: AZ70503
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ70503%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for AZ70503: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS71318%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for YS71318: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: NR25924
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR25924%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for NR25924: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND31908%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for ND31908: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER28485%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for ER28485: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: HU57894
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57894%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for HU57894: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR23669%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for UR23669: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: LR45419
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC90090%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for XC90090: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: JK13765
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK13765%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for JK13765: 0
2026-03-28 09:09:04 [auto1.it] INFO: Found listing with ID: UD57618
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD57618%27 HTTP/1.1" 200 None
2026-03-28 09:09:04 [auto1.it] INFO: Scrape type for UD57618: 0
2026-03-28 09:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:05 [scrapy.extensions.logstats] INFO: Crawled 209 pages (at 32 pages/min), scraped 155 items (at 13 items/min)
2026-03-28 09:09:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 208MiB
2026-03-28 09:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:05 [auto1.it] INFO: Channel: 24h | Page: 70 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH81414%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for FH81414: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: GT75186
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT75186%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for GT75186: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: ZY33580
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY33580%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for ZY33580: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX08227%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for FX08227: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: EC01464
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC01464%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for EC01464: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: CZ44875
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ44875%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for CZ44875: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: ZN99189
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: NG22695
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG22695%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for NG22695: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: LZ33850
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: UZ86540
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: MU30420
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU30420%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for MU30420: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: EJ86461
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ86461%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for EJ86461: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: WA22264
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: ZL89240
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ00349%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for SZ00349: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR37794%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for KR37794: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87616%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for NF87616: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: GC68104
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC68104%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for GC68104: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: HS60673
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: BT26363
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT26363%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for BT26363: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: RT50500
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT50500%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for RT50500: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: JM39933
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL56801%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for ZL56801: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU49973%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for UU49973: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR75802%27 HTTP/1.1" 200 None
2026-03-28 09:09:05 [auto1.it] INFO: Scrape type for CR75802: 0
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: XM40674
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-28 09:09:05 [auto1.it] INFO: Found listing with ID: HR54236
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR54236%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for HR54236: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD54750%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for UD54750: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: AK67199
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK67199%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for AK67199: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL39771%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for WL39771: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW57065%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for KW57065: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW60739%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for MW60739: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: LM66726
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT76958%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for GT76958: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA29565%27 HTTP/1.1" 200 None
2026-03-28 09:09:06 [auto1.it] INFO: Scrape type for VA29565: 0
2026-03-28 09:09:06 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-28 09:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:07 [auto1.it] INFO: Channel: 24h | Page: 71 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: YH58285
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: BJ23148
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ23148%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for BJ23148: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: YJ83729
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ83729%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for YJ83729: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64880%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for RV64880: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94940%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for PW94940: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK39445%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for PK39445: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC25835%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for HC25835: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: DC04279
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC04279%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for DC04279: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB05417%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for YB05417: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN31542%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for CN31542: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: DY75013
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC13059%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for UC13059: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: RU19351
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: JX57169
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX57169%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for JX57169: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: AE05588
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: AT75049
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: SE76395
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB12953%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for MB12953: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: GU93940
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU93940%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for GU93940: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86872%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for LW86872: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE96160%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for LE96160: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: FU73160
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU73160%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for FU73160: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: UF29900
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: AB86109
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: VT00900
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW24813%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for BW24813: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: GL62022
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL62022%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for GL62022: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: PV85970
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV85970%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for PV85970: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC62662%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for LC62662: 0
2026-03-28 09:09:07 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV28185%27 HTTP/1.1" 200 None
2026-03-28 09:09:07 [auto1.it] INFO: Scrape type for EV28185: 0
2026-03-28 09:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:08 [auto1.it] INFO: Channel: 24h | Page: 72 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: HR15000
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA16942%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for FA16942: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: ET15005
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET15005%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for ET15005: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH63316%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for MH63316: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP16593%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for NP16593: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: CB44170
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB44170%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for CB44170: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: BJ52580
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: BN67984
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: CV62006
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: BV13892
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV13892%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for BV13892: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: VG64666
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG64666%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for VG64666: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC82626%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for XC82626: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: WV75327
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: JC13198
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: VS87113
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: YD67684
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD67684%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for YD67684: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: VX54252
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: UA46628
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: KG92568
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG92568%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for KG92568: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: YJ41537
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: AL26239
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL26239%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for AL26239: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK60352%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for AK60352: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH30071%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for CH30071: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: CN99073
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN99073%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for CN99073: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: ES11783
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES11783%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for ES11783: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: RF56449
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF56449%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for RF56449: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19227%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for NR19227: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE11885%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for LE11885: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: LC05888
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC05888%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for LC05888: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY91699%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for HY91699: 0
2026-03-28 09:09:08 [auto1.it] INFO: Found listing with ID: ZY78533
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY78533%27 HTTP/1.1" 200 None
2026-03-28 09:09:08 [auto1.it] INFO: Scrape type for ZY78533: 0
2026-03-28 09:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:09 [auto1.it] INFO: Channel: 24h | Page: 73 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:09 [auto1.it] INFO: Found listing with ID: WH00709
2026-03-28 09:09:09 [auto1.it] INFO: Found listing with ID: YM07828
2026-03-28 09:09:09 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-28 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD99197%27 HTTP/1.1" 200 None
2026-03-28 09:09:09 [auto1.it] INFO: Scrape type for BD99197: 0
2026-03-28 09:09:09 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-28 09:09:09 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-28 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM78803%27 HTTP/1.1" 200 None
2026-03-28 09:09:09 [auto1.it] INFO: Scrape type for UM78803: 0
2026-03-28 09:09:09 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW40364%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for LW40364: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: AK92313
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK92313%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for AK92313: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK74491%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for SK74491: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN82468%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for KN82468: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF75950%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for JF75950: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: BL65453
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: PG89190
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG89190%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for PG89190: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: DX46579
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS22306%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for RS22306: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: VD33216
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: JT03140
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT03140%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for JT03140: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: ZZ64526
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ64526%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for ZZ64526: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: AC09989
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC09989%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for AC09989: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: EH65874
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH65874%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for EH65874: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: UA98317
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98317%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for UA98317: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: XE71259
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE71259%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for XE71259: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: KX33846
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX33846%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for KX33846: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: NE12117
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE12117%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for NE12117: 0
2026-03-28 09:09:10 [auto1.it] INFO: Found listing with ID: JH33133
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH33133%27 HTTP/1.1" 200 None
2026-03-28 09:09:10 [auto1.it] INFO: Scrape type for JH33133: 2
2026-03-28 09:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e0fafd-9e31-563e-a483-596645fcc097 with identifier: JH33133
2026-03-28 09:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e0fafd-9e31-563e-a483-596645fcc097 with scrape type 2
2026-03-28 09:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e0fafd-9e31-563e-a483-596645fcc097 with scrape type 2
2026-03-28 09:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93e0fafd-9e31-563e-a483-596645fcc097, identifier: JH33133
2026-03-28 09:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93e0fafd-9e31-563e-a483-596645fcc097 with identifier: JH33133
2026-03-28 09:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93e0fafd-9e31-563e-a483-596645fcc097 with identifier: JH33133
2026-03-28 09:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93e0fafd-9e31-563e-a483-596645fcc097 with identifier: JH33133 to the API
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-28T16:15:47Z',
 'fuel_type': 'diesel',
 'id': '93e0fafd-9e31-563e-a483-596645fcc097',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH33133',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 88112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 d T 4Matic Premium',
 'transmission': 'automatic',
 'trim': 'T 4Matic Premium',
 'year': 2023}
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH33133%27 HTTP/1.1" 200 None
2026-03-28 09:09:11 [auto1.it] INFO: Saving data for JH33133: {'auction_closing_time': 1774714547.0, 'created_time': 1774602348.394819, 'last_price_update_time': 1774688951.221792}
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH33133') HTTP/1.1" 204 0
2026-03-28 09:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:11 [auto1.it] INFO: Found listing with ID: UZ05025
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ05025%27 HTTP/1.1" 200 None
2026-03-28 09:09:11 [auto1.it] INFO: Scrape type for UZ05025: 0
2026-03-28 09:09:11 [auto1.it] INFO: Found listing with ID: MY92785
2026-03-28 09:09:11 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-28 09:09:11 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-28 09:09:11 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL61545%27 HTTP/1.1" 200 None
2026-03-28 09:09:11 [auto1.it] INFO: Scrape type for RL61545: 2
2026-03-28 09:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545
2026-03-28 09:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9f6915-76f2-566d-aefb-1aad37714f99 with scrape type 2
2026-03-28 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de9f6915-76f2-566d-aefb-1aad37714f99 with scrape type 2
2026-03-28 09:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de9f6915-76f2-566d-aefb-1aad37714f99, identifier: RL61545
2026-03-28 09:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545
2026-03-28 09:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545
2026-03-28 09:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545 to the API
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:25:22Z',
 'fuel_type': 'diesel',
 'id': 'de9f6915-76f2-566d-aefb-1aad37714f99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL61545',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 192906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2011}
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL61545%27 HTTP/1.1" 200 None
2026-03-28 09:09:11 [auto1.it] INFO: Saving data for RL61545: {'auction_closing_time': 1774715122.0, 'created_time': 1774602333.518208, 'last_price_update_time': 1774688951.720136}
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL61545') HTTP/1.1" 204 0
2026-03-28 09:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:12 [auto1.it] INFO: Channel: 24h | Page: 74 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:12 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-28 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA87203%27 HTTP/1.1" 200 None
2026-03-28 09:09:12 [auto1.it] INFO: Scrape type for TA87203: 2
2026-03-28 09:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203
2026-03-28 09:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f843af54-972f-516e-a4ff-0defbcfdd66a with scrape type 2
2026-03-28 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f843af54-972f-516e-a4ff-0defbcfdd66a with scrape type 2
2026-03-28 09:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f843af54-972f-516e-a4ff-0defbcfdd66a, identifier: TA87203
2026-03-28 09:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203
2026-03-28 09:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203
2026-03-28 09:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203 to the API
2026-03-28 09:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:16:01Z',
 'fuel_type': 'diesel',
 'id': 'f843af54-972f-516e-a4ff-0defbcfdd66a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA87203',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 82996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d AVANTGARDE kompakt',
 'transmission': 'automatic',
 'trim': 'AVANTGARDE kompakt',
 'year': 2021}
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA87203%27 HTTP/1.1" 200 None
2026-03-28 09:09:13 [auto1.it] INFO: Saving data for TA87203: {'auction_closing_time': 1774714561.0, 'created_time': 1773132409.663516, 'last_price_update_time': 1774688953.161119}
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TA87203') HTTP/1.1" 204 0
2026-03-28 09:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:13 [auto1.it] INFO: Found listing with ID: VV94396
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV94396%27 HTTP/1.1" 200 None
2026-03-28 09:09:13 [auto1.it] INFO: Scrape type for VV94396: 2
2026-03-28 09:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12a67b29-f214-5cbc-827b-1ee5a103919f with identifier: VV94396
2026-03-28 09:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12a67b29-f214-5cbc-827b-1ee5a103919f with scrape type 2
2026-03-28 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12a67b29-f214-5cbc-827b-1ee5a103919f with scrape type 2
2026-03-28 09:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12a67b29-f214-5cbc-827b-1ee5a103919f, identifier: VV94396
2026-03-28 09:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12a67b29-f214-5cbc-827b-1ee5a103919f with identifier: VV94396
2026-03-28 09:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12a67b29-f214-5cbc-827b-1ee5a103919f with identifier: VV94396
2026-03-28 09:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12a67b29-f214-5cbc-827b-1ee5a103919f with identifier: VV94396 to the API
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:30:07Z',
 'fuel_type': 'diesel',
 'id': '12a67b29-f214-5cbc-827b-1ee5a103919f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV94396',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 147029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Fiat 500 1.3 M-Jet Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV94396%27 HTTP/1.1" 200 None
2026-03-28 09:09:13 [auto1.it] INFO: Saving data for VV94396: {'auction_closing_time': 1774715407.0, 'created_time': 1774602343.241982, 'last_price_update_time': 1774688953.507471}
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV94396') HTTP/1.1" 204 0
2026-03-28 09:09:13 [auto1.it] INFO: Found listing with ID: EY67229
2026-03-28 09:09:13 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV29552%27 HTTP/1.1" 200 None
2026-03-28 09:09:13 [auto1.it] INFO: Scrape type for BV29552: 2
2026-03-28 09:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552
2026-03-28 09:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with scrape type 2
2026-03-28 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with scrape type 2
2026-03-28 09:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97ea31b4-3af1-5a77-b24b-c842f01fcf95, identifier: BV29552
2026-03-28 09:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552
2026-03-28 09:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552
2026-03-28 09:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552 to the API
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:36Z',
 'fuel_type': 'diesel',
 'id': '97ea31b4-3af1-5a77-b24b-c842f01fcf95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV29552',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 229634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV29552%27 HTTP/1.1" 200 None
2026-03-28 09:09:13 [auto1.it] INFO: Saving data for BV29552: {'auction_closing_time': 1774715616.0, 'created_time': 1772627794.601167, 'last_price_update_time': 1774688953.892291}
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV29552') HTTP/1.1" 204 0
2026-03-28 09:09:13 [auto1.it] INFO: Found listing with ID: EG00977
2026-03-28 09:09:13 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-28 09:09:13 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW68303%27 HTTP/1.1" 200 None
2026-03-28 09:09:13 [auto1.it] INFO: Scrape type for WW68303: 2
2026-03-28 09:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303
2026-03-28 09:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with scrape type 2
2026-03-28 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with scrape type 2
2026-03-28 09:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24fe4699-30e4-5c0b-9432-43c232bc1cb2, identifier: WW68303
2026-03-28 09:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303
2026-03-28 09:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303
2026-03-28 09:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303 to the API
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:17:07Z',
 'fuel_type': 'diesel',
 'id': '24fe4699-30e4-5c0b-9432-43c232bc1cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW68303',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 161937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM Gold',
 'transmission': 'automatic',
 'trim': 'Gold',
 'year': 2013}
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW68303%27 HTTP/1.1" 200 None
2026-03-28 09:09:14 [auto1.it] INFO: Saving data for WW68303: {'auction_closing_time': 1774714627.0, 'created_time': 1773436389.8291, 'last_price_update_time': 1774688954.29404}
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW68303') HTTP/1.1" 204 0
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: UZ72139
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ72139%27 HTTP/1.1" 200 None
2026-03-28 09:09:14 [auto1.it] INFO: Scrape type for UZ72139: 2
2026-03-28 09:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56fb950-ca54-579c-9a36-fb4cc262b788 with identifier: UZ72139
2026-03-28 09:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56fb950-ca54-579c-9a36-fb4cc262b788 with scrape type 2
2026-03-28 09:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c56fb950-ca54-579c-9a36-fb4cc262b788 with scrape type 2
2026-03-28 09:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c56fb950-ca54-579c-9a36-fb4cc262b788, identifier: UZ72139
2026-03-28 09:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c56fb950-ca54-579c-9a36-fb4cc262b788 with identifier: UZ72139
2026-03-28 09:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c56fb950-ca54-579c-9a36-fb4cc262b788 with identifier: UZ72139
2026-03-28 09:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c56fb950-ca54-579c-9a36-fb4cc262b788 with identifier: UZ72139 to the API
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:07:21Z',
 'fuel_type': 'petrol',
 'id': 'c56fb950-ca54-579c-9a36-fb4cc262b788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ72139',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 169632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-04',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ72139%27 HTTP/1.1" 200 None
2026-03-28 09:09:14 [auto1.it] INFO: Saving data for UZ72139: {'auction_closing_time': 1774714041.0, 'created_time': 1774040881.20068, 'last_price_update_time': 1774688954.776735}
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ72139') HTTP/1.1" 204 0
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH70338%27 HTTP/1.1" 200 None
2026-03-28 09:09:14 [auto1.it] INFO: Scrape type for PH70338: 0
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG18660%27 HTTP/1.1" 200 None
2026-03-28 09:09:14 [auto1.it] INFO: Scrape type for LG18660: 0
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-28 09:09:14 [auto1.it] INFO: Found listing with ID: DD38287
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD38287%27 HTTP/1.1" 200 None
2026-03-28 09:09:14 [auto1.it] INFO: Scrape type for DD38287: 2
2026-03-28 09:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62641479-fe1d-503d-8187-fc000a4a71d7 with identifier: DD38287
2026-03-28 09:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62641479-fe1d-503d-8187-fc000a4a71d7 with scrape type 2
2026-03-28 09:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62641479-fe1d-503d-8187-fc000a4a71d7 with scrape type 2
2026-03-28 09:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62641479-fe1d-503d-8187-fc000a4a71d7, identifier: DD38287
2026-03-28 09:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62641479-fe1d-503d-8187-fc000a4a71d7 with identifier: DD38287
2026-03-28 09:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62641479-fe1d-503d-8187-fc000a4a71d7 with identifier: DD38287
2026-03-28 09:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62641479-fe1d-503d-8187-fc000a4a71d7 with identifier: DD38287 to the API
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:20:39Z',
 'fuel_type': 'petrol',
 'id': '62641479-fe1d-503d-8187-fc000a4a71d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD38287',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 198618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD38287%27 HTTP/1.1" 200 None
2026-03-28 09:09:15 [auto1.it] INFO: Saving data for DD38287: {'auction_closing_time': 1774714839.0, 'created_time': 1774602345.745379, 'last_price_update_time': 1774688955.192969}
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD38287') HTTP/1.1" 204 0
2026-03-28 09:09:15 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-28 09:09:15 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-28 09:09:15 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-28 09:09:15 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA77848%27 HTTP/1.1" 200 None
2026-03-28 09:09:15 [auto1.it] INFO: Scrape type for MA77848: 0
2026-03-28 09:09:15 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ27389%27 HTTP/1.1" 200 None
2026-03-28 09:09:15 [auto1.it] INFO: Scrape type for EZ27389: 2
2026-03-28 09:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389
2026-03-28 09:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b64cd217-0dbc-509e-a661-76b6e8a3d522 with scrape type 2
2026-03-28 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b64cd217-0dbc-509e-a661-76b6e8a3d522 with scrape type 2
2026-03-28 09:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b64cd217-0dbc-509e-a661-76b6e8a3d522, identifier: EZ27389
2026-03-28 09:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389
2026-03-28 09:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389
2026-03-28 09:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389 to the API
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:22:42Z',
 'fuel_type': 'gas',
 'id': 'b64cd217-0dbc-509e-a661-76b6e8a3d522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ27389',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 143460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Benzin / LPG Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ27389%27 HTTP/1.1" 200 None
2026-03-28 09:09:15 [auto1.it] INFO: Saving data for EZ27389: {'auction_closing_time': 1774714962.0, 'created_time': 1774274893.852543, 'last_price_update_time': 1774688955.585244}
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ27389') HTTP/1.1" 204 0
2026-03-28 09:09:15 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ40909%27 HTTP/1.1" 200 None
2026-03-28 09:09:15 [auto1.it] INFO: Scrape type for NZ40909: 2
2026-03-28 09:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909
2026-03-28 09:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f2182a-4728-542a-a2bc-47112f06c6b6 with scrape type 2
2026-03-28 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f2182a-4728-542a-a2bc-47112f06c6b6 with scrape type 2
2026-03-28 09:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95f2182a-4728-542a-a2bc-47112f06c6b6, identifier: NZ40909
2026-03-28 09:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909
2026-03-28 09:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909
2026-03-28 09:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909 to the API
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:12:40Z',
 'fuel_type': 'petrol',
 'id': '95f2182a-4728-542a-a2bc-47112f06c6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ40909',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 150007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-19',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ40909%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Saving data for NZ40909: {'auction_closing_time': 1774714360.0, 'created_time': 1774274864.915358, 'last_price_update_time': 1774688956.057988}
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NZ40909') HTTP/1.1" 204 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS88689%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for VS88689: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA98059%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for KA98059: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF49180%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for FF49180: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67651%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for EV67651: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ16799%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for KZ16799: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ70208%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for HZ70208: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: VR56129
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR56129%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for VR56129: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: EJ60730
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ60730%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for EJ60730: 2
2026-03-28 09:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc206551-ce88-5898-9ce1-47ae5a34a281 with identifier: EJ60730
2026-03-28 09:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc206551-ce88-5898-9ce1-47ae5a34a281 with scrape type 2
2026-03-28 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc206551-ce88-5898-9ce1-47ae5a34a281 with scrape type 2
2026-03-28 09:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc206551-ce88-5898-9ce1-47ae5a34a281, identifier: EJ60730
2026-03-28 09:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc206551-ce88-5898-9ce1-47ae5a34a281 with identifier: EJ60730
2026-03-28 09:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc206551-ce88-5898-9ce1-47ae5a34a281 with identifier: EJ60730
2026-03-28 09:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc206551-ce88-5898-9ce1-47ae5a34a281 with identifier: EJ60730 to the API
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:47Z',
 'fuel_type': 'diesel',
 'id': 'bc206551-ce88-5898-9ce1-47ae5a34a281',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ60730',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 186256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-29',
 'seller_name': None,
 'title': 'BMW X3 2.0d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ60730%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Saving data for EJ60730: {'auction_closing_time': 1774714247.0, 'created_time': 1774602349.645083, 'last_price_update_time': 1774688956.571327}
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ60730') HTTP/1.1" 204 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ22961%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for CZ22961: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY46194%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for AY46194: 0
2026-03-28 09:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:16 [auto1.it] INFO: Channel: 24h | Page: 75 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR79135%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for PR79135: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX03621%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for FX03621: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG93268%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for AG93268: 0
2026-03-28 09:09:16 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25356%27 HTTP/1.1" 200 None
2026-03-28 09:09:16 [auto1.it] INFO: Scrape type for XV25356: 2
2026-03-28 09:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356
2026-03-28 09:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4dd963-4530-5f82-b15c-cc234b7c7fed with scrape type 2
2026-03-28 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4dd963-4530-5f82-b15c-cc234b7c7fed with scrape type 2
2026-03-28 09:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b4dd963-4530-5f82-b15c-cc234b7c7fed, identifier: XV25356
2026-03-28 09:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356
2026-03-28 09:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356
2026-03-28 09:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356 to the API
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:11:00Z',
 'fuel_type': 'diesel',
 'id': '3b4dd963-4530-5f82-b15c-cc234b7c7fed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV25356',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 44259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-06',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2021}
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25356%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Saving data for XV25356: {'auction_closing_time': 1774714260.0, 'created_time': 1774602355.476191, 'last_price_update_time': 1774688957.223256}
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV25356') HTTP/1.1" 204 0
2026-03-28 09:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN26450%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Scrape type for SN26450: 0
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV99150%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Scrape type for LV99150: 0
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG59717%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Scrape type for TG59717: 0
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD73790%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Scrape type for BD73790: 0
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH99694%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Scrape type for SH99694: 2
2026-03-28 09:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694
2026-03-28 09:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7d269ba-733d-56ac-8202-8b5db925bea4 with scrape type 2
2026-03-28 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7d269ba-733d-56ac-8202-8b5db925bea4 with scrape type 2
2026-03-28 09:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7d269ba-733d-56ac-8202-8b5db925bea4, identifier: SH99694
2026-03-28 09:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694
2026-03-28 09:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694
2026-03-28 09:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694 to the API
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:26:43Z',
 'fuel_type': 'diesel',
 'id': 'f7d269ba-733d-56ac-8202-8b5db925bea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH99694',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 304601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-15',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d Shooting Brake BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH99694%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Saving data for SH99694: {'auction_closing_time': 1774715203.0, 'created_time': 1774300051.818299, 'last_price_update_time': 1774688957.70643}
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH99694') HTTP/1.1" 204 0
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF38082%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Scrape type for NF38082: 0
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-28 09:09:17 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT68883%27 HTTP/1.1" 200 None
2026-03-28 09:09:17 [auto1.it] INFO: Scrape type for PT68883: 2
2026-03-28 09:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883
2026-03-28 09:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with scrape type 2
2026-03-28 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with scrape type 2
2026-03-28 09:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e, identifier: PT68883
2026-03-28 09:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883
2026-03-28 09:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883
2026-03-28 09:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883 to the API
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:16:38Z',
 'fuel_type': 'diesel',
 'id': 'e3ed5a5e-e4c3-5c91-a977-c2a2e187575e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT68883',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 371603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-04',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT68883%27 HTTP/1.1" 200 None
2026-03-28 09:09:18 [auto1.it] INFO: Saving data for PT68883: {'auction_closing_time': 1774714598.0, 'created_time': 1774300080.874205, 'last_price_update_time': 1774688958.19072}
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT68883') HTTP/1.1" 204 0
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG18459%27 HTTP/1.1" 200 None
2026-03-28 09:09:18 [auto1.it] INFO: Scrape type for HG18459: 2
2026-03-28 09:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459
2026-03-28 09:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e146d5a1-6e2f-587e-870f-0b09040b3b78 with scrape type 2
2026-03-28 09:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e146d5a1-6e2f-587e-870f-0b09040b3b78 with scrape type 2
2026-03-28 09:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e146d5a1-6e2f-587e-870f-0b09040b3b78, identifier: HG18459
2026-03-28 09:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459
2026-03-28 09:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459
2026-03-28 09:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459 to the API
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:25:52Z',
 'fuel_type': 'diesel',
 'id': 'e146d5a1-6e2f-587e-870f-0b09040b3b78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG18459',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 149916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-23',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG18459%27 HTTP/1.1" 200 None
2026-03-28 09:09:18 [auto1.it] INFO: Saving data for HG18459: {'auction_closing_time': 1774715152.0, 'created_time': 1774602352.618556, 'last_price_update_time': 1774688958.556106}
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG18459') HTTP/1.1" 204 0
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT34727%27 HTTP/1.1" 200 None
2026-03-28 09:09:18 [auto1.it] INFO: Scrape type for KT34727: 2
2026-03-28 09:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727
2026-03-28 09:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554f2825-3090-5972-afb0-0ffeab75b9c9 with scrape type 2
2026-03-28 09:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554f2825-3090-5972-afb0-0ffeab75b9c9 with scrape type 2
2026-03-28 09:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 554f2825-3090-5972-afb0-0ffeab75b9c9, identifier: KT34727
2026-03-28 09:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727
2026-03-28 09:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727
2026-03-28 09:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727 to the API
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:25Z',
 'fuel_type': 'petrol',
 'id': '554f2825-3090-5972-afb0-0ffeab75b9c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT34727',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TGI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT34727%27 HTTP/1.1" 200 None
2026-03-28 09:09:18 [auto1.it] INFO: Saving data for KT34727: {'auction_closing_time': 1774715425.0, 'created_time': 1774274868.495074, 'last_price_update_time': 1774688958.944746}
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT34727') HTTP/1.1" 204 0
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD43330%27 HTTP/1.1" 200 None
2026-03-28 09:09:18 [auto1.it] INFO: Scrape type for BD43330: 0
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT43083%27 HTTP/1.1" 200 None
2026-03-28 09:09:18 [auto1.it] INFO: Scrape type for FT43083: 0
2026-03-28 09:09:18 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU04780%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for HU04780: 2
2026-03-28 09:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780
2026-03-28 09:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24201b62-363b-5048-94ca-f6c86f7c0939 with scrape type 2
2026-03-28 09:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24201b62-363b-5048-94ca-f6c86f7c0939 with scrape type 2
2026-03-28 09:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24201b62-363b-5048-94ca-f6c86f7c0939, identifier: HU04780
2026-03-28 09:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780
2026-03-28 09:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780
2026-03-28 09:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780 to the API
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:34:57Z',
 'fuel_type': 'petrol',
 'id': '24201b62-363b-5048-94ca-f6c86f7c0939',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU04780',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 86545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-05',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis pulse',
 'transmission': 'automatic',
 'trim': 'Basis pulse',
 'year': 2009}
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU04780%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Saving data for HU04780: {'auction_closing_time': 1774715697.0, 'created_time': 1774274814.555555, 'last_price_update_time': 1774688959.396291}
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU04780') HTTP/1.1" 204 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for MD14180: 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY21369%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for PY21369: 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW45727%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for XW45727: 0
2026-03-28 09:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:19 [auto1.it] INFO: Channel: 24h | Page: 76 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56549%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for MJ56549: 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG49415%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for RG49415: 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT73216%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for TT73216: 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW30840%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for SW30840: 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT48153%27 HTTP/1.1" 200 None
2026-03-28 09:09:19 [auto1.it] INFO: Scrape type for JT48153: 0
2026-03-28 09:09:19 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY41121%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for XY41121: 0
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP81459%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for NP81459: 0
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30640%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for JD30640: 0
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL66559%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for WL66559: 2
2026-03-28 09:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559
2026-03-28 09:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9e11e03-0b51-5228-a8d4-38b687612ff7 with scrape type 2
2026-03-28 09:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9e11e03-0b51-5228-a8d4-38b687612ff7 with scrape type 2
2026-03-28 09:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9e11e03-0b51-5228-a8d4-38b687612ff7, identifier: WL66559
2026-03-28 09:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559
2026-03-28 09:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559
2026-03-28 09:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559 to the API
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:13:36Z',
 'fuel_type': 'petrol',
 'id': 'b9e11e03-0b51-5228-a8d4-38b687612ff7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL66559',
 'listing': 'auction',
 'make': 'EVO',
 'model': '4',
 'odometer': 28496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-16',
 'seller_name': None,
 'title': 'EVO 4 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL66559%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Saving data for WL66559: {'auction_closing_time': 1774714416.0, 'created_time': 1774300302.22499, 'last_price_update_time': 1774688960.433904}
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL66559') HTTP/1.1" 204 0
2026-03-28 09:09:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS02463%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for DS02463: 0
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM00839%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for CM00839: 0
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02319%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for TL02319: 0
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT26389%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for KT26389: 0
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-28 09:09:20 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ66710%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Scrape type for EZ66710: 2
2026-03-28 09:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710
2026-03-28 09:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with scrape type 2
2026-03-28 09:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with scrape type 2
2026-03-28 09:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07a31df6-e5bb-5b02-b66f-e8314a5a9568, identifier: EZ66710
2026-03-28 09:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710
2026-03-28 09:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710
2026-03-28 09:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710 to the API
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:22:40Z',
 'fuel_type': 'diesel',
 'id': '07a31df6-e5bb-5b02-b66f-e8314a5a9568',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ66710',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 150868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-10',
 'seller_name': None,
 'title': 'Audi Q8 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ66710%27 HTTP/1.1" 200 None
2026-03-28 09:09:20 [auto1.it] INFO: Saving data for EZ66710: {'auction_closing_time': 1774714960.0, 'created_time': 1774274804.906892, 'last_price_update_time': 1774688960.992873}
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ66710') HTTP/1.1" 204 0
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW61207%27 HTTP/1.1" 200 None
2026-03-28 09:09:21 [auto1.it] INFO: Scrape type for HW61207: 0
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ85760%27 HTTP/1.1" 200 None
2026-03-28 09:09:21 [auto1.it] INFO: Scrape type for ZZ85760: 2
2026-03-28 09:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760
2026-03-28 09:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b16eb8-2447-501e-ab98-7d71e45ad1ad with scrape type 2
2026-03-28 09:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b16eb8-2447-501e-ab98-7d71e45ad1ad with scrape type 2
2026-03-28 09:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 15b16eb8-2447-501e-ab98-7d71e45ad1ad, identifier: ZZ85760
2026-03-28 09:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760
2026-03-28 09:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760
2026-03-28 09:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760 to the API
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:29:06Z',
 'fuel_type': 'petrol',
 'id': '15b16eb8-2447-501e-ab98-7d71e45ad1ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ85760',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 134099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Seat Altea 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2013}
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ85760%27 HTTP/1.1" 200 None
2026-03-28 09:09:21 [auto1.it] INFO: Saving data for ZZ85760: {'auction_closing_time': 1774715346.0, 'created_time': 1772222832.732995, 'last_price_update_time': 1774688961.471329}
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ85760') HTTP/1.1" 204 0
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09153%27 HTTP/1.1" 200 None
2026-03-28 09:09:21 [auto1.it] INFO: Scrape type for DS09153: 0
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: DS07920
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS07920%27 HTTP/1.1" 200 None
2026-03-28 09:09:21 [auto1.it] INFO: Scrape type for DS07920: 2
2026-03-28 09:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1290ddc1-5b0b-56bf-83f3-750b91ca77a1 with identifier: DS07920
2026-03-28 09:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1290ddc1-5b0b-56bf-83f3-750b91ca77a1 with scrape type 2
2026-03-28 09:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1290ddc1-5b0b-56bf-83f3-750b91ca77a1 with scrape type 2
2026-03-28 09:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1290ddc1-5b0b-56bf-83f3-750b91ca77a1, identifier: DS07920
2026-03-28 09:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1290ddc1-5b0b-56bf-83f3-750b91ca77a1 with identifier: DS07920
2026-03-28 09:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1290ddc1-5b0b-56bf-83f3-750b91ca77a1 with identifier: DS07920
2026-03-28 09:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1290ddc1-5b0b-56bf-83f3-750b91ca77a1 with identifier: DS07920 to the API
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-28T16:21:24Z',
 'fuel_type': 'diesel',
 'id': '1290ddc1-5b0b-56bf-83f3-750b91ca77a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS07920',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 200245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2009}
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS07920%27 HTTP/1.1" 200 None
2026-03-28 09:09:21 [auto1.it] INFO: Saving data for DS07920: {'auction_closing_time': 1774714884.0, 'created_time': 1774602356.888622, 'last_price_update_time': 1774688961.844785}
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS07920') HTTP/1.1" 204 0
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-28 09:09:21 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42596%27 HTTP/1.1" 200 None
2026-03-28 09:09:21 [auto1.it] INFO: Scrape type for AH42596: 2
2026-03-28 09:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596
2026-03-28 09:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3783415c-d467-5b97-a1a6-9df607b0ef62 with scrape type 2
2026-03-28 09:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3783415c-d467-5b97-a1a6-9df607b0ef62 with scrape type 2
2026-03-28 09:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3783415c-d467-5b97-a1a6-9df607b0ef62, identifier: AH42596
2026-03-28 09:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596
2026-03-28 09:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596
2026-03-28 09:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596 to the API
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:38:01Z',
 'fuel_type': 'petrol',
 'id': '3783415c-d467-5b97-a1a6-9df607b0ef62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH42596',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 135647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42596%27 HTTP/1.1" 200 None
2026-03-28 09:09:22 [auto1.it] INFO: Saving data for AH42596: {'auction_closing_time': 1774715881.0, 'created_time': 1774267813.602716, 'last_price_update_time': 1774688962.233832}
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH42596') HTTP/1.1" 204 0
2026-03-28 09:09:22 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-28 09:09:22 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-28 09:09:22 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-28 09:09:22 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-28 09:09:22 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02542%27 HTTP/1.1" 200 None
2026-03-28 09:09:22 [auto1.it] INFO: Scrape type for WB02542: 0
2026-03-28 09:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:23 [auto1.it] INFO: Channel: 24h | Page: 77 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH68095%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for MH68095: 2
2026-03-28 09:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095
2026-03-28 09:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with scrape type 2
2026-03-28 09:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with scrape type 2
2026-03-28 09:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5, identifier: MH68095
2026-03-28 09:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095
2026-03-28 09:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095
2026-03-28 09:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095 to the API
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:52:04Z',
 'fuel_type': 'diesel',
 'id': 'a487bf4a-01f9-51ef-b70e-2f3e5195c2d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH68095',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 261687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-21',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2011}
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH68095%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Saving data for MH68095: {'auction_closing_time': 1774716724.0, 'created_time': 1774274738.416709, 'last_price_update_time': 1774688963.667376}
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH68095') HTTP/1.1" 204 0
2026-03-28 09:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT28559%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for TT28559: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG73673%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for HG73673: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ15341%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for FZ15341: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH39950%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for UH39950: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ64167%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for AZ64167: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD69394%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for HD69394: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR14764%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for UR14764: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY34648%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for XY34648: 0
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-28 09:09:23 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV49964%27 HTTP/1.1" 200 None
2026-03-28 09:09:23 [auto1.it] INFO: Scrape type for JV49964: 2
2026-03-28 09:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964
2026-03-28 09:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8a2f4f-189f-5623-85e3-01d5fd49016e with scrape type 2
2026-03-28 09:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8a2f4f-189f-5623-85e3-01d5fd49016e with scrape type 2
2026-03-28 09:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e8a2f4f-189f-5623-85e3-01d5fd49016e, identifier: JV49964
2026-03-28 09:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964
2026-03-28 09:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964
2026-03-28 09:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964 to the API
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:34:55Z',
 'fuel_type': 'petrol',
 'id': '3e8a2f4f-189f-5623-85e3-01d5fd49016e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV49964',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 44312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-VTEC Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2016}
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV49964%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Saving data for JV49964: {'auction_closing_time': 1774715695.0, 'created_time': 1774300284.006307, 'last_price_update_time': 1774688964.278991}
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV49964') HTTP/1.1" 204 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP45822%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for LP45822: 2
2026-03-28 09:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822
2026-03-28 09:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1494abcb-9148-557c-a84a-76588cda64d4 with scrape type 2
2026-03-28 09:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1494abcb-9148-557c-a84a-76588cda64d4 with scrape type 2
2026-03-28 09:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1494abcb-9148-557c-a84a-76588cda64d4, identifier: LP45822
2026-03-28 09:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822
2026-03-28 09:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822
2026-03-28 09:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822 to the API
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:29:08Z',
 'fuel_type': 'diesel',
 'id': '1494abcb-9148-557c-a84a-76588cda64d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP45822',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 189286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2017}
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP45822%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Saving data for LP45822: {'auction_closing_time': 1774715348.0, 'created_time': 1774274773.652799, 'last_price_update_time': 1774688964.781647}
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LP45822') HTTP/1.1" 204 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF78303%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for KF78303: 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS07739%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for AS07739: 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD01213%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for CD01213: 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW42527%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for EW42527: 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU78402%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for JU78402: 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ10631%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for FZ10631: 0
2026-03-28 09:09:24 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR30387%27 HTTP/1.1" 200 None
2026-03-28 09:09:24 [auto1.it] INFO: Scrape type for PR30387: 2
2026-03-28 09:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387
2026-03-28 09:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0b846f0-aec5-59ed-b87e-39cbe1d88023 with scrape type 2
2026-03-28 09:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0b846f0-aec5-59ed-b87e-39cbe1d88023 with scrape type 2
2026-03-28 09:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0b846f0-aec5-59ed-b87e-39cbe1d88023, identifier: PR30387
2026-03-28 09:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387
2026-03-28 09:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387
2026-03-28 09:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387 to the API
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:31:40Z',
 'fuel_type': 'petrol',
 'id': 'a0b846f0-aec5-59ed-b87e-39cbe1d88023',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR30387',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 27798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR30387%27 HTTP/1.1" 200 None
2026-03-28 09:09:25 [auto1.it] INFO: Saving data for PR30387: {'auction_closing_time': 1774715500.0, 'created_time': 1774274782.180945, 'last_price_update_time': 1774688965.278497}
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR30387') HTTP/1.1" 204 0
2026-03-28 09:09:25 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-03-28 09:09:25 [auto1.it] INFO: Scrape type for XD70855: 2
2026-03-28 09:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-03-28 09:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f14374-b656-5692-abe7-824b6ba4a5ca with scrape type 2
2026-03-28 09:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f14374-b656-5692-abe7-824b6ba4a5ca with scrape type 2
2026-03-28 09:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97f14374-b656-5692-abe7-824b6ba4a5ca, identifier: XD70855
2026-03-28 09:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-03-28 09:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-03-28 09:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855 to the API
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:44:22Z',
 'fuel_type': 'diesel',
 'id': '97f14374-b656-5692-abe7-824b6ba4a5ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD70855',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 113075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Premium Plus',
 'transmission': 'automatic',
 'trim': '4Matic Premium Plus',
 'year': 2022}
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-03-28 09:09:25 [auto1.it] INFO: Saving data for XD70855: {'auction_closing_time': 1774716262.0, 'created_time': 1773131155.548912, 'last_price_update_time': 1774688965.738446}
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XD70855') HTTP/1.1" 204 0
2026-03-28 09:09:25 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-28 09:09:25 [auto1.it] INFO: Found listing with ID: FD87905
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD87905%27 HTTP/1.1" 200 None
2026-03-28 09:09:25 [auto1.it] INFO: Scrape type for FD87905: 0
2026-03-28 09:09:25 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU38381%27 HTTP/1.1" 200 None
2026-03-28 09:09:25 [auto1.it] INFO: Scrape type for EU38381: 2
2026-03-28 09:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381
2026-03-28 09:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea862d00-1370-59cd-b496-9925118b23f9 with scrape type 2
2026-03-28 09:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea862d00-1370-59cd-b496-9925118b23f9 with scrape type 2
2026-03-28 09:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea862d00-1370-59cd-b496-9925118b23f9, identifier: EU38381
2026-03-28 09:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381
2026-03-28 09:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381
2026-03-28 09:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381 to the API
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-28T16:38:07Z',
 'fuel_type': 'gas',
 'id': 'ea862d00-1370-59cd-b496-9925118b23f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38381',
 'listing': 'auction',
 'make': 'EVO',
 'model': '5',
 'odometer': 58950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-12',
 'seller_name': None,
 'title': 'EVO 5 1.6 LPG',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU38381%27 HTTP/1.1" 200 None
2026-03-28 09:09:26 [auto1.it] INFO: Saving data for EU38381: {'auction_closing_time': 1774715887.0, 'created_time': 1774472817.885367, 'last_price_update_time': 1774688966.213161}
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU38381') HTTP/1.1" 204 0
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99644%27 HTTP/1.1" 200 None
2026-03-28 09:09:26 [auto1.it] INFO: Scrape type for EA99644: 0
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT94062%27 HTTP/1.1" 200 None
2026-03-28 09:09:26 [auto1.it] INFO: Scrape type for FT94062: 0
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: ED98224
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED98224%27 HTTP/1.1" 200 None
2026-03-28 09:09:26 [auto1.it] INFO: Scrape type for ED98224: 0
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG94514%27 HTTP/1.1" 200 None
2026-03-28 09:09:26 [auto1.it] INFO: Scrape type for WG94514: 0
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: NT11806
2026-03-28 09:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:26 [auto1.it] INFO: Channel: 24h | Page: 78 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52577%27 HTTP/1.1" 200 None
2026-03-28 09:09:26 [auto1.it] INFO: Scrape type for PZ52577: 0
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-28 09:09:26 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM35614%27 HTTP/1.1" 200 None
2026-03-28 09:09:26 [auto1.it] INFO: Scrape type for ZM35614: 2
2026-03-28 09:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614
2026-03-28 09:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64bffd1f-b745-5109-b8e3-95fd732bbb65 with scrape type 2
2026-03-28 09:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64bffd1f-b745-5109-b8e3-95fd732bbb65 with scrape type 2
2026-03-28 09:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64bffd1f-b745-5109-b8e3-95fd732bbb65, identifier: ZM35614
2026-03-28 09:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614
2026-03-28 09:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614
2026-03-28 09:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614 to the API
2026-03-28 09:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:17:34Z',
 'fuel_type': 'diesel',
 'id': '64bffd1f-b745-5109-b8e3-95fd732bbb65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM35614',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 198475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM35614%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Saving data for ZM35614: {'auction_closing_time': 1774714654.0, 'created_time': 1774274748.973551, 'last_price_update_time': 1774688967.106478}
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM35614') HTTP/1.1" 204 0
2026-03-28 09:09:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS29770%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Scrape type for FS29770: 0
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: XW21530
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU63843%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Scrape type for PU63843: 0
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR85753%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Scrape type for SR85753: 0
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: LC41998
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ26377%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Scrape type for TZ26377: 0
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV75074%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Scrape type for ZV75074: 2
2026-03-28 09:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074
2026-03-28 09:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7b1e40-154b-554e-9007-1d93126c7e0f with scrape type 2
2026-03-28 09:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e7b1e40-154b-554e-9007-1d93126c7e0f with scrape type 2
2026-03-28 09:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e7b1e40-154b-554e-9007-1d93126c7e0f, identifier: ZV75074
2026-03-28 09:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074
2026-03-28 09:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074
2026-03-28 09:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074 to the API
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:15:38Z',
 'fuel_type': 'petrol',
 'id': '2e7b1e40-154b-554e-9007-1d93126c7e0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV75074',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 98301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-21',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Natural Power Panda',
 'transmission': 'manual',
 'trim': 'Natural Power',
 'year': 2010}
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV75074%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Saving data for ZV75074: {'auction_closing_time': 1774714538.0, 'created_time': 1774300239.052066, 'last_price_update_time': 1774688967.687148}
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV75074') HTTP/1.1" 204 0
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP26264%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Scrape type for CP26264: 0
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-28 09:09:27 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC32215%27 HTTP/1.1" 200 None
2026-03-28 09:09:27 [auto1.it] INFO: Scrape type for XC32215: 2
2026-03-28 09:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215
2026-03-28 09:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33055a65-0e52-5536-baa6-99bd91d3d112 with scrape type 2
2026-03-28 09:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33055a65-0e52-5536-baa6-99bd91d3d112 with scrape type 2
2026-03-28 09:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33055a65-0e52-5536-baa6-99bd91d3d112, identifier: XC32215
2026-03-28 09:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215
2026-03-28 09:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215
2026-03-28 09:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215 to the API
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:25:39Z',
 'fuel_type': 'petrol',
 'id': '33055a65-0e52-5536-baa6-99bd91d3d112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC32215',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 58596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-20',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC32215%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Saving data for XC32215: {'auction_closing_time': 1774715139.0, 'created_time': 1774602365.78909, 'last_price_update_time': 1774688968.071046}
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC32215') HTTP/1.1" 204 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL48638%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for RL48638: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ97051%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for MZ97051: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV74338%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for DV74338: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD83320%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for RD83320: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC73004%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for FC73004: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK76860%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for UK76860: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH07717%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for XH07717: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR80508%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for FR80508: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH37521%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for CH37521: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV42265%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for CV42265: 2
2026-03-28 09:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265
2026-03-28 09:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4634efff-d31b-58db-be84-2a197ad5e800 with scrape type 2
2026-03-28 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4634efff-d31b-58db-be84-2a197ad5e800 with scrape type 2
2026-03-28 09:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4634efff-d31b-58db-be84-2a197ad5e800, identifier: CV42265
2026-03-28 09:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265
2026-03-28 09:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265
2026-03-28 09:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265 to the API
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:32:01Z',
 'fuel_type': 'diesel',
 'id': '4634efff-d31b-58db-be84-2a197ad5e800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV42265',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 199993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV42265%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Saving data for CV42265: {'auction_closing_time': 1774715521.0, 'created_time': 1773232873.551658, 'last_price_update_time': 1774688968.715072}
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV42265') HTTP/1.1" 204 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX50484%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for TX50484: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC65145%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for TC65145: 0
2026-03-28 09:09:28 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG53706%27 HTTP/1.1" 200 None
2026-03-28 09:09:28 [auto1.it] INFO: Scrape type for SG53706: 2
2026-03-28 09:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706
2026-03-28 09:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb3ab0eb-3c2e-525b-806a-d111f53af72e with scrape type 2
2026-03-28 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb3ab0eb-3c2e-525b-806a-d111f53af72e with scrape type 2
2026-03-28 09:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb3ab0eb-3c2e-525b-806a-d111f53af72e, identifier: SG53706
2026-03-28 09:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706
2026-03-28 09:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706
2026-03-28 09:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706 to the API
2026-03-28 09:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:25:25Z',
 'fuel_type': 'diesel',
 'id': 'bb3ab0eb-3c2e-525b-806a-d111f53af72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG53706',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 315098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-20',
 'seller_name': None,
 'title': 'Ford Focus 1.8 TDCi Zetec',
 'transmission': 'manual',
 'trim': 'Zetec',
 'year': 2004}
2026-03-28 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG53706%27 HTTP/1.1" 200 None
2026-03-28 09:09:29 [auto1.it] INFO: Saving data for SG53706: {'auction_closing_time': 1774715125.0, 'created_time': 1774602371.729465, 'last_price_update_time': 1774688969.209483}
2026-03-28 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG53706') HTTP/1.1" 204 0
2026-03-28 09:09:29 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-28 09:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:30 [auto1.it] INFO: Channel: 24h | Page: 79 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER04044%27 HTTP/1.1" 200 None
2026-03-28 09:09:30 [auto1.it] INFO: Scrape type for ER04044: 0
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: PG80369
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG80369%27 HTTP/1.1" 200 None
2026-03-28 09:09:30 [auto1.it] INFO: Scrape type for PG80369: 2
2026-03-28 09:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e783803-467d-5346-9cec-d845c1747bb1 with identifier: PG80369
2026-03-28 09:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e783803-467d-5346-9cec-d845c1747bb1 with scrape type 2
2026-03-28 09:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e783803-467d-5346-9cec-d845c1747bb1 with scrape type 2
2026-03-28 09:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e783803-467d-5346-9cec-d845c1747bb1, identifier: PG80369
2026-03-28 09:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e783803-467d-5346-9cec-d845c1747bb1 with identifier: PG80369
2026-03-28 09:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e783803-467d-5346-9cec-d845c1747bb1 with identifier: PG80369
2026-03-28 09:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e783803-467d-5346-9cec-d845c1747bb1 with identifier: PG80369 to the API
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:57Z',
 'fuel_type': 'petrol',
 'id': '2e783803-467d-5346-9cec-d845c1747bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG80369',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 89773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2022}
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG80369%27 HTTP/1.1" 200 None
2026-03-28 09:09:30 [auto1.it] INFO: Saving data for PG80369: {'auction_closing_time': 1774716897.0, 'created_time': 1774602370.13308, 'last_price_update_time': 1774688970.411526}
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PG80369') HTTP/1.1" 204 0
2026-03-28 09:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-28 09:09:30 [auto1.it] INFO: Scrape type for YA87774: 2
2026-03-28 09:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774
2026-03-28 09:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8574da1e-39e6-523c-97ed-effbcf2aebb4 with scrape type 2
2026-03-28 09:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8574da1e-39e6-523c-97ed-effbcf2aebb4 with scrape type 2
2026-03-28 09:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8574da1e-39e6-523c-97ed-effbcf2aebb4, identifier: YA87774
2026-03-28 09:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774
2026-03-28 09:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774
2026-03-28 09:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774 to the API
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:27:51Z',
 'fuel_type': 'petrol',
 'id': '8574da1e-39e6-523c-97ed-effbcf2aebb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA87774',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 78350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Black up!',
 'transmission': 'manual',
 'trim': 'Black',
 'year': 2012}
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-28 09:09:30 [auto1.it] INFO: Saving data for YA87774: {'auction_closing_time': 1774715271.0, 'created_time': 1774274767.68964, 'last_price_update_time': 1774688970.870452}
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA87774') HTTP/1.1" 204 0
2026-03-28 09:09:30 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU61390%27 HTTP/1.1" 200 None
2026-03-28 09:09:30 [auto1.it] INFO: Scrape type for MU61390: 2
2026-03-28 09:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390
2026-03-28 09:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c0b116-93b5-579a-aa61-1afce1a8afcd with scrape type 2
2026-03-28 09:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18c0b116-93b5-579a-aa61-1afce1a8afcd with scrape type 2
2026-03-28 09:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18c0b116-93b5-579a-aa61-1afce1a8afcd, identifier: MU61390
2026-03-28 09:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390
2026-03-28 09:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390
2026-03-28 09:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390 to the API
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:24:05Z',
 'fuel_type': 'diesel',
 'id': '18c0b116-93b5-579a-aa61-1afce1a8afcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU61390',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 192655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-29',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2007}
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU61390%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Saving data for MU61390: {'auction_closing_time': 1774715045.0, 'created_time': 1774101982.98848, 'last_price_update_time': 1774688971.605694}
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU61390') HTTP/1.1" 204 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA70519%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for PA70519: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05419%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for SC05419: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG89993%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for EG89993: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT44801%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for TT44801: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR85251%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for BR85251: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML20734%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for ML20734: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ56254%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for ZZ56254: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX56381%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for CX56381: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: UG05722
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX44191%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for UX44191: 0
2026-03-28 09:09:31 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU39445%27 HTTP/1.1" 200 None
2026-03-28 09:09:31 [auto1.it] INFO: Scrape type for ZU39445: 2
2026-03-28 09:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445
2026-03-28 09:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46545a60-9771-5716-8a72-9d4fb0de3a2a with scrape type 2
2026-03-28 09:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46545a60-9771-5716-8a72-9d4fb0de3a2a with scrape type 2
2026-03-28 09:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46545a60-9771-5716-8a72-9d4fb0de3a2a, identifier: ZU39445
2026-03-28 09:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445
2026-03-28 09:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445
2026-03-28 09:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445 to the API
2026-03-28 09:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:36:30Z',
 'fuel_type': 'diesel',
 'id': '46545a60-9771-5716-8a72-9d4fb0de3a2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU39445',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 433775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-12',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.6 HDi Seduction 2WD',
 'transmission': 'manual',
 'trim': 'Seduction 2WD',
 'year': 2013}
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU39445%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Saving data for ZU39445: {'auction_closing_time': 1774715790.0, 'created_time': 1774602369.234973, 'last_price_update_time': 1774688972.109631}
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU39445') HTTP/1.1" 204 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM00919%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for WM00919: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: YU40333
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB00155%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for XB00155: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08559%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for VY08559: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT24064%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for DT24064: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF97148%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for AF97148: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW75020%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for EW75020: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG00486%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for XG00486: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU33914%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for YU33914: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN78206%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for SN78206: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH25620%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for PH25620: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH53431%27 HTTP/1.1" 200 None
2026-03-28 09:09:32 [auto1.it] INFO: Scrape type for MH53431: 0
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-28 09:09:32 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-28 09:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:33 [auto1.it] INFO: Channel: 24h | Page: 80 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: RH67441
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG84271%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for YG84271: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: UY38032
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT97007%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for TT97007: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT53480%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for GT53480: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL33082%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for RL33082: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG24306%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for TG24306: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY57551%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for LY57551: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE58096%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for HE58096: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN84990%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for PN84990: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB65897%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for FB65897: 2
2026-03-28 09:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897
2026-03-28 09:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b18727-b23c-5d6c-8faa-e711dbc8882e with scrape type 2
2026-03-28 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b18727-b23c-5d6c-8faa-e711dbc8882e with scrape type 2
2026-03-28 09:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9b18727-b23c-5d6c-8faa-e711dbc8882e, identifier: FB65897
2026-03-28 09:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897
2026-03-28 09:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897
2026-03-28 09:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897 to the API
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:26:10Z',
 'fuel_type': 'diesel',
 'id': 'a9b18727-b23c-5d6c-8faa-e711dbc8882e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB65897',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 216490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB65897%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Saving data for FB65897: {'auction_closing_time': 1774715170.0, 'created_time': 1772622818.788718, 'last_price_update_time': 1774688973.8072}
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB65897') HTTP/1.1" 204 0
2026-03-28 09:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF31033%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for KF31033: 0
2026-03-28 09:09:33 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-03-28 09:09:33 [auto1.it] INFO: Scrape type for RA25408: 2
2026-03-28 09:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-03-28 09:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 2
2026-03-28 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 2
2026-03-28 09:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 741d7026-0aac-5c3b-8af5-ab758388ede6, identifier: RA25408
2026-03-28 09:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-03-28 09:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-03-28 09:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408 to the API
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:16:47Z',
 'fuel_type': 'hybrid',
 'id': '741d7026-0aac-5c3b-8af5-ab758388ede6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA25408',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 81577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2023}
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Saving data for RA25408: {'auction_closing_time': 1774714607.0, 'created_time': 1774602374.784215, 'last_price_update_time': 1774688974.453087}
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA25408') HTTP/1.1" 204 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG02437%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for KG02437: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP78893%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for DP78893: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ66117%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for UJ66117: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG99585%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for BG99585: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54731%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for JR54731: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU83939%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for JU83939: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: AL62204
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS09351%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for SS09351: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK49323%27 HTTP/1.1" 200 None
2026-03-28 09:09:34 [auto1.it] INFO: Scrape type for SK49323: 0
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-28 09:09:34 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-28 09:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:35 [auto1.it] INFO: Channel: 24h | Page: 81 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW29692%27 HTTP/1.1" 200 None
2026-03-28 09:09:35 [auto1.it] INFO: Scrape type for LW29692: 0
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: JV83854
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39462%27 HTTP/1.1" 200 None
2026-03-28 09:09:35 [auto1.it] INFO: Scrape type for XJ39462: 0
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB02604%27 HTTP/1.1" 200 None
2026-03-28 09:09:35 [auto1.it] INFO: Scrape type for NB02604: 0
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22715%27 HTTP/1.1" 200 None
2026-03-28 09:09:35 [auto1.it] INFO: Scrape type for HS22715: 0
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-28 09:09:35 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW35808%27 HTTP/1.1" 200 None
2026-03-28 09:09:35 [auto1.it] INFO: Scrape type for DW35808: 2
2026-03-28 09:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808
2026-03-28 09:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 197d26e9-af65-5a3d-873e-30db2bb00576 with scrape type 2
2026-03-28 09:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 197d26e9-af65-5a3d-873e-30db2bb00576 with scrape type 2
2026-03-28 09:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 197d26e9-af65-5a3d-873e-30db2bb00576, identifier: DW35808
2026-03-28 09:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808
2026-03-28 09:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808
2026-03-28 09:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808 to the API
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:35:45Z',
 'fuel_type': 'diesel',
 'id': '197d26e9-af65-5a3d-873e-30db2bb00576',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW35808',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 161402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2021}
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW35808%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Saving data for DW35808: {'auction_closing_time': 1774715745.0, 'created_time': 1774275005.076173, 'last_price_update_time': 1774688976.240945}
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW35808') HTTP/1.1" 204 0
2026-03-28 09:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN99841%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for RN99841: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH59018%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for LH59018: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP47784%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for AP47784: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL30811%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for AL30811: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY70774%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for JY70774: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: WW01067
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW01067%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for WW01067: 2
2026-03-28 09:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e781f728-9267-53c8-99b0-67d35f160df4 with identifier: WW01067
2026-03-28 09:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e781f728-9267-53c8-99b0-67d35f160df4 with scrape type 2
2026-03-28 09:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e781f728-9267-53c8-99b0-67d35f160df4 with scrape type 2
2026-03-28 09:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e781f728-9267-53c8-99b0-67d35f160df4, identifier: WW01067
2026-03-28 09:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e781f728-9267-53c8-99b0-67d35f160df4 with identifier: WW01067
2026-03-28 09:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e781f728-9267-53c8-99b0-67d35f160df4 with identifier: WW01067
2026-03-28 09:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e781f728-9267-53c8-99b0-67d35f160df4 with identifier: WW01067 to the API
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:44:51Z',
 'fuel_type': 'petrol',
 'id': 'e781f728-9267-53c8-99b0-67d35f160df4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW01067',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'StreetKa',
 'odometer': 8314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-10',
 'seller_name': None,
 'title': 'Ford StreetKa 1.6 Basis Roadster',
 'transmission': 'manual',
 'trim': 'Basis Roadster',
 'year': 2003}
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW01067%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Saving data for WW01067: {'auction_closing_time': 1774716291.0, 'created_time': 1774602380.683923, 'last_price_update_time': 1774688976.832435}
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW01067') HTTP/1.1" 204 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN60691%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for CN60691: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31309%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for BR31309: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC03945%27 HTTP/1.1" 200 None
2026-03-28 09:09:36 [auto1.it] INFO: Scrape type for DC03945: 0
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-28 09:09:36 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-28 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB60435%27 HTTP/1.1" 200 None
2026-03-28 09:09:37 [auto1.it] INFO: Scrape type for TB60435: 0
2026-03-28 09:09:37 [auto1.it] INFO: Found listing with ID: ZA78643
2026-03-28 09:09:37 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-28 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC37401%27 HTTP/1.1" 200 None
2026-03-28 09:09:37 [auto1.it] INFO: Scrape type for VC37401: 0
2026-03-28 09:09:37 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-28 09:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:38 [auto1.it] INFO: Channel: 24h | Page: 82 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ29519%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for GZ29519: 0
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ63404%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for NJ63404: 0
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG76075%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for VG76075: 0
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG86392%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for ZG86392: 0
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE99850%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for RE99850: 0
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK80279%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for SK80279: 2
2026-03-28 09:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279
2026-03-28 09:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351c6ef1-92a2-5346-8a16-9402044bdd62 with scrape type 2
2026-03-28 09:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 351c6ef1-92a2-5346-8a16-9402044bdd62 with scrape type 2
2026-03-28 09:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 351c6ef1-92a2-5346-8a16-9402044bdd62, identifier: SK80279
2026-03-28 09:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279
2026-03-28 09:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279
2026-03-28 09:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279 to the API
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:06:01Z',
 'fuel_type': 'diesel',
 'id': '351c6ef1-92a2-5346-8a16-9402044bdd62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK80279',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 86116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seller_name': None,
 'title': 'Land Rover Evoque D180 Mild-Hybrid R-dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-dynamic SE',
 'year': 2019}
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK80279%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Saving data for SK80279: {'auction_closing_time': 1774713961.0, 'created_time': 1774274817.5766, 'last_price_update_time': 1774688978.716218}
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK80279') HTTP/1.1" 204 0
2026-03-28 09:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: US69373
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC67394%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for NC67394: 0
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-28 09:09:38 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW82018%27 HTTP/1.1" 200 None
2026-03-28 09:09:38 [auto1.it] INFO: Scrape type for HW82018: 2
2026-03-28 09:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018
2026-03-28 09:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with scrape type 2
2026-03-28 09:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with scrape type 2
2026-03-28 09:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5, identifier: HW82018
2026-03-28 09:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018
2026-03-28 09:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018
2026-03-28 09:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018 to the API
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:18Z',
 'fuel_type': 'diesel',
 'id': 'ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW82018',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 166990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW82018%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Saving data for HW82018: {'auction_closing_time': 1774714518.0, 'created_time': 1773135688.439802, 'last_price_update_time': 1774688979.243585}
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW82018') HTTP/1.1" 204 0
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08024%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Scrape type for VY08024: 2
2026-03-28 09:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024
2026-03-28 09:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e03c9b-55b5-50cf-b946-17936586f9ad with scrape type 2
2026-03-28 09:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e03c9b-55b5-50cf-b946-17936586f9ad with scrape type 2
2026-03-28 09:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 68e03c9b-55b5-50cf-b946-17936586f9ad, identifier: VY08024
2026-03-28 09:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024
2026-03-28 09:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024
2026-03-28 09:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024 to the API
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:38:02Z',
 'fuel_type': 'petrol',
 'id': '68e03c9b-55b5-50cf-b946-17936586f9ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY08024',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 72004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-21',
 'seller_name': None,
 'title': 'MINI Clubman John Cooper Works ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2020}
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08024%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Saving data for VY08024: {'auction_closing_time': 1774715882.0, 'created_time': 1773131756.75807, 'last_price_update_time': 1774688979.656117}
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY08024') HTTP/1.1" 204 0
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: AE09913
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE09913%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Scrape type for AE09913: 0
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH88339%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Scrape type for TH88339: 0
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ18858%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Scrape type for XJ18858: 0
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF96122%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Scrape type for NF96122: 0
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: SX04553
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA39078%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Scrape type for GA39078: 0
2026-03-28 09:09:39 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP92326%27 HTTP/1.1" 200 None
2026-03-28 09:09:39 [auto1.it] INFO: Scrape type for JP92326: 2
2026-03-28 09:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326
2026-03-28 09:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with scrape type 2
2026-03-28 09:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with scrape type 2
2026-03-28 09:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89, identifier: JP92326
2026-03-28 09:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326
2026-03-28 09:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326
2026-03-28 09:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326 to the API
2026-03-28 09:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:58:24Z',
 'fuel_type': 'diesel',
 'id': '4e18bb4a-3e30-5a32-afe8-0f88da5b7f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP92326',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 212819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-28',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP92326%27 HTTP/1.1" 200 None
2026-03-28 09:09:40 [auto1.it] INFO: Saving data for JP92326: {'auction_closing_time': 1774717104.0, 'created_time': 1774602388.45518, 'last_price_update_time': 1774688980.128112}
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP92326') HTTP/1.1" 204 0
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ97902%27 HTTP/1.1" 200 None
2026-03-28 09:09:40 [auto1.it] INFO: Scrape type for MJ97902: 0
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH17321%27 HTTP/1.1" 200 None
2026-03-28 09:09:40 [auto1.it] INFO: Scrape type for XH17321: 2
2026-03-28 09:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321
2026-03-28 09:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with scrape type 2
2026-03-28 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with scrape type 2
2026-03-28 09:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd, identifier: XH17321
2026-03-28 09:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321
2026-03-28 09:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321
2026-03-28 09:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321 to the API
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:08:59Z',
 'fuel_type': 'petrol',
 'id': 'f53ae3f8-a7ab-57b4-8888-93bd534c3fdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH17321',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 66783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-30',
 'seller_name': None,
 'title': 'Ford Fusion 1.4 Zetec',
 'transmission': 'manual',
 'trim': 'Zetec',
 'year': 2005}
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH17321%27 HTTP/1.1" 200 None
2026-03-28 09:09:40 [auto1.it] INFO: Saving data for XH17321: {'auction_closing_time': 1774714139.0, 'created_time': 1774300053.381202, 'last_price_update_time': 1774688980.614239}
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH17321') HTTP/1.1" 204 0
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK90576%27 HTTP/1.1" 200 None
2026-03-28 09:09:40 [auto1.it] INFO: Scrape type for SK90576: 0
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF76752%27 HTTP/1.1" 200 None
2026-03-28 09:09:40 [auto1.it] INFO: Scrape type for FF76752: 0
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: WY95771
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY95771%27 HTTP/1.1" 200 None
2026-03-28 09:09:40 [auto1.it] INFO: Scrape type for WY95771: 0
2026-03-28 09:09:40 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-28 09:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:41 [auto1.it] INFO: Channel: 24h | Page: 83 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA53057%27 HTTP/1.1" 200 None
2026-03-28 09:09:41 [auto1.it] INFO: Scrape type for PA53057: 0
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL40655%27 HTTP/1.1" 200 None
2026-03-28 09:09:41 [auto1.it] INFO: Scrape type for TL40655: 0
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ19111%27 HTTP/1.1" 200 None
2026-03-28 09:09:41 [auto1.it] INFO: Scrape type for TJ19111: 2
2026-03-28 09:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111
2026-03-28 09:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with scrape type 2
2026-03-28 09:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with scrape type 2
2026-03-28 09:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c, identifier: TJ19111
2026-03-28 09:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111
2026-03-28 09:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111
2026-03-28 09:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111 to the API
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:48:11Z',
 'fuel_type': 'petrol',
 'id': 'ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ19111',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 54889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ19111%27 HTTP/1.1" 200 None
2026-03-28 09:09:41 [auto1.it] INFO: Saving data for TJ19111: {'auction_closing_time': 1774716491.0, 'created_time': 1774602388.992329, 'last_price_update_time': 1774688981.860613}
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ19111') HTTP/1.1" 204 0
2026-03-28 09:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-28 09:09:41 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR16221%27 HTTP/1.1" 200 None
2026-03-28 09:09:41 [auto1.it] INFO: Scrape type for MR16221: 2
2026-03-28 09:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221
2026-03-28 09:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24950bd3-e936-5be9-8681-b00ce47756c3 with scrape type 2
2026-03-28 09:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24950bd3-e936-5be9-8681-b00ce47756c3 with scrape type 2
2026-03-28 09:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24950bd3-e936-5be9-8681-b00ce47756c3, identifier: MR16221
2026-03-28 09:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221
2026-03-28 09:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221
2026-03-28 09:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221 to the API
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:53:53Z',
 'fuel_type': 'diesel',
 'id': '24950bd3-e936-5be9-8681-b00ce47756c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR16221',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 159543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2018}
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR16221%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Saving data for MR16221: {'auction_closing_time': 1774716833.0, 'created_time': 1773137829.799785, 'last_price_update_time': 1774688982.347452}
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR16221') HTTP/1.1" 204 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP04797%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for YP04797: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: LS49318
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW56281%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for ZW56281: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET21203%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for ET21203: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV89112%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for SV89112: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL07806%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for ZL07806: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: XX96776
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP87516%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for DP87516: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV75261%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for GV75261: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV74767%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for TV74767: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW82008%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for YW82008: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT31033%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for RT31033: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12322%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for DW12322: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL13838%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for HL13838: 0
2026-03-28 09:09:42 [auto1.it] INFO: Found listing with ID: KS49913
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS49913%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Scrape type for KS49913: 2
2026-03-28 09:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913
2026-03-28 09:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with scrape type 2
2026-03-28 09:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with scrape type 2
2026-03-28 09:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7, identifier: KS49913
2026-03-28 09:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913
2026-03-28 09:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913
2026-03-28 09:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913 to the API
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:30:08Z',
 'fuel_type': 'petrol',
 'id': 'b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS49913',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 69026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS49913%27 HTTP/1.1" 200 None
2026-03-28 09:09:42 [auto1.it] INFO: Saving data for KS49913: {'auction_closing_time': 1774715408.0, 'created_time': 1773328005.547618, 'last_price_update_time': 1774688982.957542}
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KS49913') HTTP/1.1" 204 0
2026-03-28 09:09:43 [auto1.it] INFO: Found listing with ID: BT22959
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT22959%27 HTTP/1.1" 200 None
2026-03-28 09:09:43 [auto1.it] INFO: Scrape type for BT22959: 2
2026-03-28 09:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3584a2b2-036d-5fbd-b979-2e9cea9bb3e8 with identifier: BT22959
2026-03-28 09:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3584a2b2-036d-5fbd-b979-2e9cea9bb3e8 with scrape type 2
2026-03-28 09:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3584a2b2-036d-5fbd-b979-2e9cea9bb3e8 with scrape type 2
2026-03-28 09:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3584a2b2-036d-5fbd-b979-2e9cea9bb3e8, identifier: BT22959
2026-03-28 09:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3584a2b2-036d-5fbd-b979-2e9cea9bb3e8 with identifier: BT22959
2026-03-28 09:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3584a2b2-036d-5fbd-b979-2e9cea9bb3e8 with identifier: BT22959
2026-03-28 09:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3584a2b2-036d-5fbd-b979-2e9cea9bb3e8 with identifier: BT22959 to the API
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:01:21Z',
 'fuel_type': 'petrol',
 'id': '3584a2b2-036d-5fbd-b979-2e9cea9bb3e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT22959',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 56617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2023}
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT22959%27 HTTP/1.1" 200 None
2026-03-28 09:09:43 [auto1.it] INFO: Saving data for BT22959: {'auction_closing_time': 1774713681.0, 'created_time': 1773136625.986457, 'last_price_update_time': 1774688983.422468}
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT22959') HTTP/1.1" 204 0
2026-03-28 09:09:43 [auto1.it] INFO: Found listing with ID: MN59888
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN59888%27 HTTP/1.1" 200 None
2026-03-28 09:09:43 [auto1.it] INFO: Scrape type for MN59888: 2
2026-03-28 09:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92acfae0-1e9d-52d4-b5ea-570919fe7474 with identifier: MN59888
2026-03-28 09:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92acfae0-1e9d-52d4-b5ea-570919fe7474 with scrape type 2
2026-03-28 09:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92acfae0-1e9d-52d4-b5ea-570919fe7474 with scrape type 2
2026-03-28 09:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92acfae0-1e9d-52d4-b5ea-570919fe7474, identifier: MN59888
2026-03-28 09:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92acfae0-1e9d-52d4-b5ea-570919fe7474 with identifier: MN59888
2026-03-28 09:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92acfae0-1e9d-52d4-b5ea-570919fe7474 with identifier: MN59888
2026-03-28 09:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92acfae0-1e9d-52d4-b5ea-570919fe7474 with identifier: MN59888 to the API
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:22:20Z',
 'fuel_type': 'petrol',
 'id': '92acfae0-1e9d-52d4-b5ea-570919fe7474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN59888',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 59383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-28',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech C-Series',
 'transmission': 'manual',
 'trim': 'C-Series',
 'year': 2023}
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN59888%27 HTTP/1.1" 200 None
2026-03-28 09:09:43 [auto1.it] INFO: Saving data for MN59888: {'auction_closing_time': 1774714940.0, 'created_time': 1773136339.466892, 'last_price_update_time': 1774688983.8126}
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN59888') HTTP/1.1" 204 0
2026-03-28 09:09:43 [auto1.it] INFO: Found listing with ID: FW35723
2026-03-28 09:09:43 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR27714%27 HTTP/1.1" 200 None
2026-03-28 09:09:43 [auto1.it] INFO: Scrape type for KR27714: 2
2026-03-28 09:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714
2026-03-28 09:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 537228b3-fa25-5f9e-b168-c918b03315f9 with scrape type 2
2026-03-28 09:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 537228b3-fa25-5f9e-b168-c918b03315f9 with scrape type 2
2026-03-28 09:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 537228b3-fa25-5f9e-b168-c918b03315f9, identifier: KR27714
2026-03-28 09:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714
2026-03-28 09:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714
2026-03-28 09:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714 to the API
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:04:48Z',
 'fuel_type': 'diesel',
 'id': '537228b3-fa25-5f9e-b168-c918b03315f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR27714',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 102579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-22',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2012}
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR27714%27 HTTP/1.1" 200 None
2026-03-28 09:09:44 [auto1.it] INFO: Saving data for KR27714: {'auction_closing_time': 1774713888.0, 'created_time': 1772784614.419114, 'last_price_update_time': 1774688984.20282}
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR27714') HTTP/1.1" 204 0
2026-03-28 09:09:44 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED22447%27 HTTP/1.1" 200 None
2026-03-28 09:09:44 [auto1.it] INFO: Scrape type for ED22447: 0
2026-03-28 09:09:44 [auto1.it] INFO: Found listing with ID: VJ79188
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ79188%27 HTTP/1.1" 200 None
2026-03-28 09:09:44 [auto1.it] INFO: Scrape type for VJ79188: 2
2026-03-28 09:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5eb5d67-7e3f-5f97-8884-ba388698c643 with identifier: VJ79188
2026-03-28 09:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5eb5d67-7e3f-5f97-8884-ba388698c643 with scrape type 2
2026-03-28 09:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5eb5d67-7e3f-5f97-8884-ba388698c643 with scrape type 2
2026-03-28 09:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5eb5d67-7e3f-5f97-8884-ba388698c643, identifier: VJ79188
2026-03-28 09:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5eb5d67-7e3f-5f97-8884-ba388698c643 with identifier: VJ79188
2026-03-28 09:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5eb5d67-7e3f-5f97-8884-ba388698c643 with identifier: VJ79188
2026-03-28 09:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5eb5d67-7e3f-5f97-8884-ba388698c643 with identifier: VJ79188 to the API
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:37:26Z',
 'fuel_type': 'diesel',
 'id': 'f5eb5d67-7e3f-5f97-8884-ba388698c643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ79188',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 179541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-29',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ79188%27 HTTP/1.1" 200 None
2026-03-28 09:09:44 [auto1.it] INFO: Saving data for VJ79188: {'auction_closing_time': 1774715846.0, 'created_time': 1774602430.361499, 'last_price_update_time': 1774688984.606783}
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ79188') HTTP/1.1" 204 0
2026-03-28 09:09:44 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-28 09:09:44 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV37243%27 HTTP/1.1" 200 None
2026-03-28 09:09:44 [auto1.it] INFO: Scrape type for WV37243: 2
2026-03-28 09:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243
2026-03-28 09:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36cd066-49a8-5825-922e-e3e60f34fdbe with scrape type 2
2026-03-28 09:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f36cd066-49a8-5825-922e-e3e60f34fdbe with scrape type 2
2026-03-28 09:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f36cd066-49a8-5825-922e-e3e60f34fdbe, identifier: WV37243
2026-03-28 09:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243
2026-03-28 09:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243
2026-03-28 09:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243 to the API
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:59:35Z',
 'fuel_type': 'diesel',
 'id': 'f36cd066-49a8-5825-922e-e3e60f34fdbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV37243',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 164559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV37243%27 HTTP/1.1" 200 None
2026-03-28 09:09:45 [auto1.it] INFO: Saving data for WV37243: {'auction_closing_time': 1774717175.0, 'created_time': 1772568047.063719, 'last_price_update_time': 1774688985.014893}
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV37243') HTTP/1.1" 204 0
2026-03-28 09:09:45 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB13262%27 HTTP/1.1" 200 None
2026-03-28 09:09:45 [auto1.it] INFO: Scrape type for JB13262: 2
2026-03-28 09:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262
2026-03-28 09:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c02b8b-9544-544c-a433-1519d8b819e6 with scrape type 2
2026-03-28 09:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c02b8b-9544-544c-a433-1519d8b819e6 with scrape type 2
2026-03-28 09:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54c02b8b-9544-544c-a433-1519d8b819e6, identifier: JB13262
2026-03-28 09:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262
2026-03-28 09:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262
2026-03-28 09:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262 to the API
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:53:54Z',
 'fuel_type': 'petrol',
 'id': '54c02b8b-9544-544c-a433-1519d8b819e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB13262',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 142599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-27',
 'seller_name': None,
 'title': 'Lancia Delta 1.4 Turbo Oro',
 'transmission': 'manual',
 'trim': 'Oro',
 'year': 2009}
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB13262%27 HTTP/1.1" 200 None
2026-03-28 09:09:45 [auto1.it] INFO: Saving data for JB13262: {'auction_closing_time': 1774716834.0, 'created_time': 1774602432.108561, 'last_price_update_time': 1774688985.398382}
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB13262') HTTP/1.1" 204 0
2026-03-28 09:09:45 [auto1.it] INFO: Channel: 24h | Page: 84 | totalHits: 3443 | hits on page: 40
2026-03-28 09:09:45 [auto1.it] INFO: Found listing with ID: CC61798
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC61798%27 HTTP/1.1" 200 None
2026-03-28 09:09:45 [auto1.it] INFO: Scrape type for CC61798: 2
2026-03-28 09:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed69cc5-c114-54e1-a6d1-a0d73e70e44d with identifier: CC61798
2026-03-28 09:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed69cc5-c114-54e1-a6d1-a0d73e70e44d with scrape type 2
2026-03-28 09:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eed69cc5-c114-54e1-a6d1-a0d73e70e44d with scrape type 2
2026-03-28 09:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eed69cc5-c114-54e1-a6d1-a0d73e70e44d, identifier: CC61798
2026-03-28 09:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eed69cc5-c114-54e1-a6d1-a0d73e70e44d with identifier: CC61798
2026-03-28 09:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eed69cc5-c114-54e1-a6d1-a0d73e70e44d with identifier: CC61798
2026-03-28 09:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eed69cc5-c114-54e1-a6d1-a0d73e70e44d with identifier: CC61798 to the API
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:52Z',
 'fuel_type': 'petrol',
 'id': 'eed69cc5-c114-54e1-a6d1-a0d73e70e44d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC61798',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 184357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC61798%27 HTTP/1.1" 200 None
2026-03-28 09:09:45 [auto1.it] INFO: Saving data for CC61798: {'auction_closing_time': 1774716292.0, 'created_time': 1774602421.764047, 'last_price_update_time': 1774688985.79499}
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CC61798') HTTP/1.1" 204 0
2026-03-28 09:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:45 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD34729%27 HTTP/1.1" 200 None
2026-03-28 09:09:45 [auto1.it] INFO: Scrape type for WD34729: 2
2026-03-28 09:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729
2026-03-28 09:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36564643-d038-5dda-a81d-9c1e3fcfb76f with scrape type 2
2026-03-28 09:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36564643-d038-5dda-a81d-9c1e3fcfb76f with scrape type 2
2026-03-28 09:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36564643-d038-5dda-a81d-9c1e3fcfb76f, identifier: WD34729
2026-03-28 09:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729
2026-03-28 09:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729
2026-03-28 09:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729 to the API
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:23:45Z',
 'fuel_type': 'gas',
 'id': '36564643-d038-5dda-a81d-9c1e3fcfb76f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD34729',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 99476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2012}
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD34729%27 HTTP/1.1" 200 None
2026-03-28 09:09:46 [auto1.it] INFO: Saving data for WD34729: {'auction_closing_time': 1774715025.0, 'created_time': 1773131822.927658, 'last_price_update_time': 1774688986.214756}
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD34729') HTTP/1.1" 204 0
2026-03-28 09:09:46 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH41983%27 HTTP/1.1" 200 None
2026-03-28 09:09:46 [auto1.it] INFO: Scrape type for XH41983: 2
2026-03-28 09:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983
2026-03-28 09:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34177cd2-f993-58b9-a77d-fd8e6f163141 with scrape type 2
2026-03-28 09:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34177cd2-f993-58b9-a77d-fd8e6f163141 with scrape type 2
2026-03-28 09:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34177cd2-f993-58b9-a77d-fd8e6f163141, identifier: XH41983
2026-03-28 09:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983
2026-03-28 09:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983
2026-03-28 09:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983 to the API
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:56:08Z',
 'fuel_type': 'diesel',
 'id': '34177cd2-f993-58b9-a77d-fd8e6f163141',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41983',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 290306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-31',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH41983%27 HTTP/1.1" 200 None
2026-03-28 09:09:46 [auto1.it] INFO: Saving data for XH41983: {'auction_closing_time': 1774716968.0, 'created_time': 1774602429.633157, 'last_price_update_time': 1774688986.692141}
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH41983') HTTP/1.1" 204 0
2026-03-28 09:09:46 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-28 09:09:46 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-28 09:09:46 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT93241%27 HTTP/1.1" 200 None
2026-03-28 09:09:46 [auto1.it] INFO: Scrape type for RT93241: 2
2026-03-28 09:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241
2026-03-28 09:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66af43d4-9a9e-5bc9-8f81-38899ce7274d with scrape type 2
2026-03-28 09:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66af43d4-9a9e-5bc9-8f81-38899ce7274d with scrape type 2
2026-03-28 09:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66af43d4-9a9e-5bc9-8f81-38899ce7274d, identifier: RT93241
2026-03-28 09:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241
2026-03-28 09:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241
2026-03-28 09:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241 to the API
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:04:25Z',
 'fuel_type': 'diesel',
 'id': '66af43d4-9a9e-5bc9-8f81-38899ce7274d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT93241',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 147240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT93241%27 HTTP/1.1" 200 None
2026-03-28 09:09:47 [auto1.it] INFO: Saving data for RT93241: {'auction_closing_time': 1774713865.0, 'created_time': 1774602436.752333, 'last_price_update_time': 1774688987.108879}
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT93241') HTTP/1.1" 204 0
2026-03-28 09:09:47 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY04213%27 HTTP/1.1" 200 None
2026-03-28 09:09:47 [auto1.it] INFO: Scrape type for RY04213: 2
2026-03-28 09:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213
2026-03-28 09:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa486cf-c736-5661-9818-5c706ee54e04 with scrape type 2
2026-03-28 09:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aa486cf-c736-5661-9818-5c706ee54e04 with scrape type 2
2026-03-28 09:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0aa486cf-c736-5661-9818-5c706ee54e04, identifier: RY04213
2026-03-28 09:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213
2026-03-28 09:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213
2026-03-28 09:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213 to the API
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:30:34Z',
 'fuel_type': 'diesel',
 'id': '0aa486cf-c736-5661-9818-5c706ee54e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY04213',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'New Beetle',
 'odometer': 131789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-28',
 'seller_name': None,
 'title': 'Volkswagen New Beetle 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY04213%27 HTTP/1.1" 200 None
2026-03-28 09:09:47 [auto1.it] INFO: Saving data for RY04213: {'auction_closing_time': 1774715434.0, 'created_time': 1773136058.982633, 'last_price_update_time': 1774688987.514615}
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY04213') HTTP/1.1" 204 0
2026-03-28 09:09:47 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-28 09:09:47 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-28 09:09:47 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-28 09:09:47 [auto1.it] INFO: Found listing with ID: JE32335
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32335%27 HTTP/1.1" 200 None
2026-03-28 09:09:47 [auto1.it] INFO: Scrape type for JE32335: 2
2026-03-28 09:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327c3a8d-1258-562e-984e-84d9a0731c9f with identifier: JE32335
2026-03-28 09:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327c3a8d-1258-562e-984e-84d9a0731c9f with scrape type 2
2026-03-28 09:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 327c3a8d-1258-562e-984e-84d9a0731c9f with scrape type 2
2026-03-28 09:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 327c3a8d-1258-562e-984e-84d9a0731c9f, identifier: JE32335
2026-03-28 09:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 327c3a8d-1258-562e-984e-84d9a0731c9f with identifier: JE32335
2026-03-28 09:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 327c3a8d-1258-562e-984e-84d9a0731c9f with identifier: JE32335
2026-03-28 09:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 327c3a8d-1258-562e-984e-84d9a0731c9f with identifier: JE32335 to the API
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:55Z',
 'fuel_type': 'diesel',
 'id': '327c3a8d-1258-562e-984e-84d9a0731c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE32335',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 220383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-05',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.3 JTD Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2009}
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32335%27 HTTP/1.1" 200 None
2026-03-28 09:09:47 [auto1.it] INFO: Saving data for JE32335: {'auction_closing_time': 1774714735.0, 'created_time': 1774602439.84696, 'last_price_update_time': 1774688987.896251}
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE32335') HTTP/1.1" 204 0
2026-03-28 09:09:47 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-28 09:09:47 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR54413%27 HTTP/1.1" 200 None
2026-03-28 09:09:47 [auto1.it] INFO: Scrape type for LR54413: 2
2026-03-28 09:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413
2026-03-28 09:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acce316b-2e92-51c0-b21e-6558c1f38989 with scrape type 2
2026-03-28 09:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acce316b-2e92-51c0-b21e-6558c1f38989 with scrape type 2
2026-03-28 09:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: acce316b-2e92-51c0-b21e-6558c1f38989, identifier: LR54413
2026-03-28 09:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413
2026-03-28 09:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413
2026-03-28 09:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413 to the API
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:41:49Z',
 'fuel_type': 'diesel',
 'id': 'acce316b-2e92-51c0-b21e-6558c1f38989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR54413',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 227216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2011}
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR54413%27 HTTP/1.1" 200 None
2026-03-28 09:09:48 [auto1.it] INFO: Saving data for LR54413: {'auction_closing_time': 1774716109.0, 'created_time': 1772186486.887383, 'last_price_update_time': 1774688988.301675}
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR54413') HTTP/1.1" 204 0
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN19179%27 HTTP/1.1" 200 None
2026-03-28 09:09:48 [auto1.it] INFO: Scrape type for XN19179: 2
2026-03-28 09:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179
2026-03-28 09:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5eb161d-dc48-55b5-99a8-a028a7be7e88 with scrape type 2
2026-03-28 09:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5eb161d-dc48-55b5-99a8-a028a7be7e88 with scrape type 2
2026-03-28 09:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5eb161d-dc48-55b5-99a8-a028a7be7e88, identifier: XN19179
2026-03-28 09:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179
2026-03-28 09:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179
2026-03-28 09:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179 to the API
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:17:28Z',
 'fuel_type': 'diesel',
 'id': 'a5eb161d-dc48-55b5-99a8-a028a7be7e88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN19179',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 93700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Duel',
 'transmission': 'manual',
 'trim': 'Duel',
 'year': 2016}
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN19179%27 HTTP/1.1" 200 None
2026-03-28 09:09:48 [auto1.it] INFO: Saving data for XN19179: {'auction_closing_time': 1774714648.0, 'created_time': 1773129501.044921, 'last_price_update_time': 1774688988.83513}
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XN19179') HTTP/1.1" 204 0
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB88786%27 HTTP/1.1" 200 None
2026-03-28 09:09:48 [auto1.it] INFO: Scrape type for SB88786: 0
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: HE93915
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-28 09:09:48 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-28 09:09:48 [auto1.it] INFO: Scrape type for JS62412: 2
2026-03-28 09:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412
2026-03-28 09:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3a2ca1-1a90-5f26-96ce-77dc766ec30d with scrape type 2
2026-03-28 09:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de3a2ca1-1a90-5f26-96ce-77dc766ec30d with scrape type 2
2026-03-28 09:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de3a2ca1-1a90-5f26-96ce-77dc766ec30d, identifier: JS62412
2026-03-28 09:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412
2026-03-28 09:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412
2026-03-28 09:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412 to the API
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:50Z',
 'fuel_type': 'diesel',
 'id': 'de3a2ca1-1a90-5f26-96ce-77dc766ec30d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS62412',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 75485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Cool 2WD',
 'transmission': 'manual',
 'trim': 'Cool 2WD',
 'year': 2014}
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-28 09:09:49 [auto1.it] INFO: Saving data for JS62412: {'auction_closing_time': 1774716410.0, 'created_time': 1774602434.849187, 'last_price_update_time': 1774688989.251892}
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS62412') HTTP/1.1" 204 0
2026-03-28 09:09:49 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV11200%27 HTTP/1.1" 200 None
2026-03-28 09:09:49 [auto1.it] INFO: Scrape type for ZV11200: 2
2026-03-28 09:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-03-28 09:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 144334f5-960b-5ac4-8d04-293507acb064 with scrape type 2
2026-03-28 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 144334f5-960b-5ac4-8d04-293507acb064 with scrape type 2
2026-03-28 09:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 144334f5-960b-5ac4-8d04-293507acb064, identifier: ZV11200
2026-03-28 09:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-03-28 09:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-03-28 09:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200 to the API
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:41:37Z',
 'fuel_type': 'gas',
 'id': '144334f5-960b-5ac4-8d04-293507acb064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV11200',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 141853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Benzin / LPG Laureate Family 4x2',
 'transmission': 'manual',
 'trim': 'Laureate Family 4x2',
 'year': 2016}
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV11200%27 HTTP/1.1" 200 None
2026-03-28 09:09:49 [auto1.it] INFO: Saving data for ZV11200: {'auction_closing_time': 1774716097.0, 'created_time': 1774602422.757154, 'last_price_update_time': 1774688989.629344}
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV11200') HTTP/1.1" 204 0
2026-03-28 09:09:49 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46834%27 HTTP/1.1" 200 None
2026-03-28 09:09:49 [auto1.it] INFO: Scrape type for ZZ46834: 2
2026-03-28 09:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834
2026-03-28 09:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96181f94-5de2-5872-9b3a-925dfea00be1 with scrape type 2
2026-03-28 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96181f94-5de2-5872-9b3a-925dfea00be1 with scrape type 2
2026-03-28 09:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96181f94-5de2-5872-9b3a-925dfea00be1, identifier: ZZ46834
2026-03-28 09:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834
2026-03-28 09:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834
2026-03-28 09:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834 to the API
2026-03-28 09:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:57:10Z',
 'fuel_type': 'diesel',
 'id': '96181f94-5de2-5872-9b3a-925dfea00be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ46834',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 112251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2018}
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46834%27 HTTP/1.1" 200 None
2026-03-28 09:09:50 [auto1.it] INFO: Saving data for ZZ46834: {'auction_closing_time': 1774717030.0, 'created_time': 1773136060.73377, 'last_price_update_time': 1774688990.114634}
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ46834') HTTP/1.1" 204 0
2026-03-28 09:09:50 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR66434%27 HTTP/1.1" 200 None
2026-03-28 09:09:50 [auto1.it] INFO: Scrape type for HR66434: 2
2026-03-28 09:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434
2026-03-28 09:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with scrape type 2
2026-03-28 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with scrape type 2
2026-03-28 09:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1, identifier: HR66434
2026-03-28 09:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434
2026-03-28 09:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434
2026-03-28 09:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434 to the API
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:21:45Z',
 'fuel_type': 'diesel',
 'id': '0ffe0dd0-40a2-50ef-8c66-07beb24157b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR66434',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 249190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2015}
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR66434%27 HTTP/1.1" 200 None
2026-03-28 09:09:50 [auto1.it] INFO: Saving data for HR66434: {'auction_closing_time': 1774714905.0, 'created_time': 1774602427.224447, 'last_price_update_time': 1774688990.487169}
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR66434') HTTP/1.1" 204 0
2026-03-28 09:09:50 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25944%27 HTTP/1.1" 200 None
2026-03-28 09:09:50 [auto1.it] INFO: Scrape type for ZK25944: 2
2026-03-28 09:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944
2026-03-28 09:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f21246-681b-5f0a-a886-1f27570b079b with scrape type 2
2026-03-28 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f21246-681b-5f0a-a886-1f27570b079b with scrape type 2
2026-03-28 09:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4f21246-681b-5f0a-a886-1f27570b079b, identifier: ZK25944
2026-03-28 09:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944
2026-03-28 09:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944
2026-03-28 09:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944 to the API
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:28:49Z',
 'fuel_type': 'petrol',
 'id': 'a4f21246-681b-5f0a-a886-1f27570b079b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK25944',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 29475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2012}
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25944%27 HTTP/1.1" 200 None
2026-03-28 09:09:50 [auto1.it] INFO: Saving data for ZK25944: {'auction_closing_time': 1774715329.0, 'created_time': 1774602440.691375, 'last_price_update_time': 1774688990.863479}
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK25944') HTTP/1.1" 204 0
2026-03-28 09:09:50 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-28 09:09:50 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU08042%27 HTTP/1.1" 200 None
2026-03-28 09:09:50 [auto1.it] INFO: Scrape type for EU08042: 2
2026-03-28 09:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042
2026-03-28 09:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with scrape type 2
2026-03-28 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with scrape type 2
2026-03-28 09:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c, identifier: EU08042
2026-03-28 09:09:50 [auto1.it] INFO: Channel: 24h | Page: 85 | totalHits: 3444 | hits on page: 40
2026-03-28 09:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042
2026-03-28 09:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042
2026-03-28 09:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042 to the API
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:04:26Z',
 'fuel_type': 'petrol',
 'id': '39cb64be-3f9f-515c-913f-3c84dcfa7f9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU08042',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 129731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2018}
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU08042%27 HTTP/1.1" 200 None
2026-03-28 09:09:51 [auto1.it] INFO: Saving data for EU08042: {'auction_closing_time': 1774713866.0, 'created_time': 1774602434.470392, 'last_price_update_time': 1774688991.23803}
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU08042') HTTP/1.1" 204 0
2026-03-28 09:09:51 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-28 09:09:51 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ82738%27 HTTP/1.1" 200 None
2026-03-28 09:09:51 [auto1.it] INFO: Scrape type for RJ82738: 2
2026-03-28 09:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738
2026-03-28 09:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a68f4c75-e018-55e2-a10a-66130601d4f0 with scrape type 2
2026-03-28 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a68f4c75-e018-55e2-a10a-66130601d4f0 with scrape type 2
2026-03-28 09:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a68f4c75-e018-55e2-a10a-66130601d4f0, identifier: RJ82738
2026-03-28 09:09:51 [auto1.it] INFO: Found listing with ID: MA06356
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA06356%27 HTTP/1.1" 200 None
2026-03-28 09:09:51 [auto1.it] INFO: Scrape type for MA06356: 2
2026-03-28 09:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4de48b6-a79d-5e06-9e8d-29c025b39a99 with identifier: MA06356
2026-03-28 09:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4de48b6-a79d-5e06-9e8d-29c025b39a99 with scrape type 2
2026-03-28 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4de48b6-a79d-5e06-9e8d-29c025b39a99 with scrape type 2
2026-03-28 09:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4de48b6-a79d-5e06-9e8d-29c025b39a99, identifier: MA06356
2026-03-28 09:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738
2026-03-28 09:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738
2026-03-28 09:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738 to the API
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:15Z',
 'fuel_type': 'diesel',
 'id': 'a68f4c75-e018-55e2-a10a-66130601d4f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ82738',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 151802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ82738%27 HTTP/1.1" 200 None
2026-03-28 09:09:51 [auto1.it] INFO: Saving data for RJ82738: {'auction_closing_time': 1774715955.0, 'created_time': 1774602403.755559, 'last_price_update_time': 1774688991.728496}
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ82738') HTTP/1.1" 204 0
2026-03-28 09:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4de48b6-a79d-5e06-9e8d-29c025b39a99 with identifier: MA06356
2026-03-28 09:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4de48b6-a79d-5e06-9e8d-29c025b39a99 with identifier: MA06356
2026-03-28 09:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4de48b6-a79d-5e06-9e8d-29c025b39a99 with identifier: MA06356 to the API
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:37Z',
 'fuel_type': 'diesel',
 'id': 'b4de48b6-a79d-5e06-9e8d-29c025b39a99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA06356',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 164886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-27',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA06356%27 HTTP/1.1" 200 None
2026-03-28 09:09:51 [auto1.it] INFO: Saving data for MA06356: {'auction_closing_time': 1774715197.0, 'created_time': 1774602426.641897, 'last_price_update_time': 1774688991.97579}
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA06356') HTTP/1.1" 204 0
2026-03-28 09:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:51 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR83709%27 HTTP/1.1" 200 None
2026-03-28 09:09:52 [auto1.it] INFO: Scrape type for UR83709: 0
2026-03-28 09:09:52 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-28 09:09:52 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP73975%27 HTTP/1.1" 200 None
2026-03-28 09:09:52 [auto1.it] INFO: Scrape type for ZP73975: 0
2026-03-28 09:09:52 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX64348%27 HTTP/1.1" 200 None
2026-03-28 09:09:52 [auto1.it] INFO: Scrape type for LX64348: 2
2026-03-28 09:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348
2026-03-28 09:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e783db1c-85c0-5309-b73f-cc9f6585a184 with scrape type 2
2026-03-28 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e783db1c-85c0-5309-b73f-cc9f6585a184 with scrape type 2
2026-03-28 09:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e783db1c-85c0-5309-b73f-cc9f6585a184, identifier: LX64348
2026-03-28 09:09:52 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-28 09:09:52 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-28 09:09:52 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ69368%27 HTTP/1.1" 200 None
2026-03-28 09:09:52 [auto1.it] INFO: Scrape type for BJ69368: 2
2026-03-28 09:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368
2026-03-28 09:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113104dc-3f72-5e09-a1ed-8997aa3362c5 with scrape type 2
2026-03-28 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113104dc-3f72-5e09-a1ed-8997aa3362c5 with scrape type 2
2026-03-28 09:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 113104dc-3f72-5e09-a1ed-8997aa3362c5, identifier: BJ69368
2026-03-28 09:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348
2026-03-28 09:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348
2026-03-28 09:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348 to the API
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:17:11Z',
 'fuel_type': 'diesel',
 'id': 'e783db1c-85c0-5309-b73f-cc9f6585a184',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX64348',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 173281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid High Tech',
 'transmission': 'automatic',
 'trim': 'High Tech',
 'year': 2021}
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX64348%27 HTTP/1.1" 200 None
2026-03-28 09:09:52 [auto1.it] INFO: Saving data for LX64348: {'auction_closing_time': 1774714631.0, 'created_time': 1772273158.057487, 'last_price_update_time': 1774688992.614644}
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX64348') HTTP/1.1" 204 0
2026-03-28 09:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368
2026-03-28 09:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368
2026-03-28 09:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368 to the API
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:37:45Z',
 'fuel_type': 'diesel',
 'id': '113104dc-3f72-5e09-a1ed-8997aa3362c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ69368',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 336247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-09',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ69368%27 HTTP/1.1" 200 None
2026-03-28 09:09:52 [auto1.it] INFO: Saving data for BJ69368: {'auction_closing_time': 1774715865.0, 'created_time': 1774602411.448214, 'last_price_update_time': 1774688992.989146}
2026-03-28 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ69368') HTTP/1.1" 204 0
2026-03-28 09:09:53 [auto1.it] INFO: Found listing with ID: RY42018
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY42018%27 HTTP/1.1" 200 None
2026-03-28 09:09:53 [auto1.it] INFO: Scrape type for RY42018: 2
2026-03-28 09:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aefd43f-85bf-50a8-9680-4443f2b1aeff with identifier: RY42018
2026-03-28 09:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aefd43f-85bf-50a8-9680-4443f2b1aeff with scrape type 2
2026-03-28 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aefd43f-85bf-50a8-9680-4443f2b1aeff with scrape type 2
2026-03-28 09:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2aefd43f-85bf-50a8-9680-4443f2b1aeff, identifier: RY42018
2026-03-28 09:09:53 [auto1.it] INFO: Found listing with ID: DT48918
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT48918%27 HTTP/1.1" 200 None
2026-03-28 09:09:53 [auto1.it] INFO: Scrape type for DT48918: 2
2026-03-28 09:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f96f233-62ce-5dfa-a5e0-ad674e4d12b0 with identifier: DT48918
2026-03-28 09:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f96f233-62ce-5dfa-a5e0-ad674e4d12b0 with scrape type 2
2026-03-28 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f96f233-62ce-5dfa-a5e0-ad674e4d12b0 with scrape type 2
2026-03-28 09:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f96f233-62ce-5dfa-a5e0-ad674e4d12b0, identifier: DT48918
2026-03-28 09:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2aefd43f-85bf-50a8-9680-4443f2b1aeff with identifier: RY42018
2026-03-28 09:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2aefd43f-85bf-50a8-9680-4443f2b1aeff with identifier: RY42018
2026-03-28 09:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2aefd43f-85bf-50a8-9680-4443f2b1aeff with identifier: RY42018 to the API
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:19:54Z',
 'fuel_type': 'hybrid',
 'id': '2aefd43f-85bf-50a8-9680-4443f2b1aeff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY42018',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 33834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY42018%27 HTTP/1.1" 200 None
2026-03-28 09:09:53 [auto1.it] INFO: Saving data for RY42018: {'auction_closing_time': 1774714794.0, 'created_time': 1774447548.688673, 'last_price_update_time': 1774688993.497816}
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY42018') HTTP/1.1" 204 0
2026-03-28 09:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f96f233-62ce-5dfa-a5e0-ad674e4d12b0 with identifier: DT48918
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 09:09:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f96f233-62ce-5dfa-a5e0-ad674e4d12b0 with identifier: DT48918
2026-03-28 09:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f96f233-62ce-5dfa-a5e0-ad674e4d12b0 with identifier: DT48918 to the API
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:17:57Z',
 'fuel_type': 'petrol',
 'id': '0f96f233-62ce-5dfa-a5e0-ad674e4d12b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT48918',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 179269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT48918%27 HTTP/1.1" 200 None
2026-03-28 09:09:53 [auto1.it] INFO: Saving data for DT48918: {'auction_closing_time': 1774714677.0, 'created_time': 1774602433.340874, 'last_price_update_time': 1774688993.868491}
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT48918') HTTP/1.1" 204 0
2026-03-28 09:09:53 [auto1.it] INFO: Found listing with ID: MX61025
2026-03-28 09:09:53 [auto1.it] INFO: Found listing with ID: UL18238
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL18238%27 HTTP/1.1" 200 None
2026-03-28 09:09:53 [auto1.it] INFO: Scrape type for UL18238: 2
2026-03-28 09:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238
2026-03-28 09:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0bf2c2-f36f-584a-8369-724405605674 with scrape type 2
2026-03-28 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0bf2c2-f36f-584a-8369-724405605674 with scrape type 2
2026-03-28 09:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed0bf2c2-f36f-584a-8369-724405605674, identifier: UL18238
2026-03-28 09:09:53 [auto1.it] INFO: Found listing with ID: VL74139
2026-03-28 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL74139%27 HTTP/1.1" 200 None
2026-03-28 09:09:54 [auto1.it] INFO: Scrape type for VL74139: 2
2026-03-28 09:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc7bc11-9e33-5737-8005-d1e20d73d468 with identifier: VL74139
2026-03-28 09:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc7bc11-9e33-5737-8005-d1e20d73d468 with scrape type 2
2026-03-28 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc7bc11-9e33-5737-8005-d1e20d73d468 with scrape type 2
2026-03-28 09:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4cc7bc11-9e33-5737-8005-d1e20d73d468, identifier: VL74139
2026-03-28 09:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238
2026-03-28 09:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238
2026-03-28 09:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238 to the API
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:20:31Z',
 'fuel_type': 'petrol',
 'id': 'ed0bf2c2-f36f-584a-8369-724405605674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL18238',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 207135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-27',
 'seller_name': None,
 'title': 'Audi A6 55 TFSI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL18238%27 HTTP/1.1" 200 None
2026-03-28 09:09:54 [auto1.it] INFO: Saving data for UL18238: {'auction_closing_time': 1774714831.0, 'created_time': 1774602407.763406, 'last_price_update_time': 1774688994.357298}
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL18238') HTTP/1.1" 204 0
2026-03-28 09:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4cc7bc11-9e33-5737-8005-d1e20d73d468 with identifier: VL74139
2026-03-28 09:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4cc7bc11-9e33-5737-8005-d1e20d73d468 with identifier: VL74139
2026-03-28 09:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4cc7bc11-9e33-5737-8005-d1e20d73d468 with identifier: VL74139 to the API
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:03:52Z',
 'fuel_type': 'diesel',
 'id': '4cc7bc11-9e33-5737-8005-d1e20d73d468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL74139',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 259903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2017}
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL74139%27 HTTP/1.1" 200 None
2026-03-28 09:09:54 [auto1.it] INFO: Saving data for VL74139: {'auction_closing_time': 1774713832.0, 'created_time': 1774602419.845794, 'last_price_update_time': 1774688994.618726}
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL74139') HTTP/1.1" 204 0
2026-03-28 09:09:54 [auto1.it] INFO: Found listing with ID: UA98347
2026-03-28 09:09:54 [auto1.it] INFO: Found listing with ID: MA06356
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA06356%27 HTTP/1.1" 200 None
2026-03-28 09:09:54 [auto1.it] INFO: Scrape type for MA06356: 0
2026-03-28 09:09:54 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-28 09:09:54 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW07837%27 HTTP/1.1" 200 None
2026-03-28 09:09:54 [auto1.it] INFO: Scrape type for BW07837: 2
2026-03-28 09:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837
2026-03-28 09:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c2dd93-266e-5570-af62-92bf84ecab70 with scrape type 2
2026-03-28 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c2dd93-266e-5570-af62-92bf84ecab70 with scrape type 2
2026-03-28 09:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20c2dd93-266e-5570-af62-92bf84ecab70, identifier: BW07837
2026-03-28 09:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837
2026-03-28 09:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837
2026-03-28 09:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837 to the API
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:00:06Z',
 'fuel_type': 'diesel',
 'id': '20c2dd93-266e-5570-af62-92bf84ecab70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW07837',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 158155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.3 M-Jet Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW07837%27 HTTP/1.1" 200 None
2026-03-28 09:09:55 [auto1.it] INFO: Saving data for BW07837: {'auction_closing_time': 1774713606.0, 'created_time': 1774602441.361816, 'last_price_update_time': 1774688995.009309}
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW07837') HTTP/1.1" 204 0
2026-03-28 09:09:55 [auto1.it] INFO: Found listing with ID: GL09473
2026-03-28 09:09:55 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-28 09:09:55 [auto1.it] INFO: Found listing with ID: AS27324
2026-03-28 09:09:55 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD12881%27 HTTP/1.1" 200 None
2026-03-28 09:09:55 [auto1.it] INFO: Scrape type for WD12881: 2
2026-03-28 09:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881
2026-03-28 09:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bd8467-027d-5672-b2e9-678d305e2445 with scrape type 2
2026-03-28 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bd8467-027d-5672-b2e9-678d305e2445 with scrape type 2
2026-03-28 09:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8bd8467-027d-5672-b2e9-678d305e2445, identifier: WD12881
2026-03-28 09:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881
2026-03-28 09:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881
2026-03-28 09:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881 to the API
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:27:22Z',
 'fuel_type': 'diesel',
 'id': 'b8bd8467-027d-5672-b2e9-678d305e2445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD12881',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 139075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-26',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2017}
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD12881%27 HTTP/1.1" 200 None
2026-03-28 09:09:55 [auto1.it] INFO: Saving data for WD12881: {'auction_closing_time': 1774715242.0, 'created_time': 1774602449.595466, 'last_price_update_time': 1774688995.376756}
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD12881') HTTP/1.1" 204 0
2026-03-28 09:09:55 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP84134%27 HTTP/1.1" 200 None
2026-03-28 09:09:55 [auto1.it] INFO: Scrape type for XP84134: 2
2026-03-28 09:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134
2026-03-28 09:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with scrape type 2
2026-03-28 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with scrape type 2
2026-03-28 09:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e, identifier: XP84134
2026-03-28 09:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134
2026-03-28 09:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134
2026-03-28 09:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134 to the API
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:09:05Z',
 'fuel_type': 'diesel',
 'id': '36f87db7-6bc8-5047-be1e-ae40aa9efb3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP84134',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 150494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-16',
 'seller_name': None,
 'title': 'BMW 2er 216d Active Tourer',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP84134%27 HTTP/1.1" 200 None
2026-03-28 09:09:55 [auto1.it] INFO: Saving data for XP84134: {'auction_closing_time': 1774714145.0, 'created_time': 1774602450.432194, 'last_price_update_time': 1774688995.829513}
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XP84134') HTTP/1.1" 204 0
2026-03-28 09:09:55 [auto1.it] INFO: Found listing with ID: DX59233
2026-03-28 09:09:55 [auto1.it] INFO: Found listing with ID: US24028
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US24028%27 HTTP/1.1" 200 None
2026-03-28 09:09:55 [auto1.it] INFO: Scrape type for US24028: 2
2026-03-28 09:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028
2026-03-28 09:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6047d389-5c8a-5622-932a-8e15f5c7aa4c with scrape type 2
2026-03-28 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6047d389-5c8a-5622-932a-8e15f5c7aa4c with scrape type 2
2026-03-28 09:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6047d389-5c8a-5622-932a-8e15f5c7aa4c, identifier: US24028
2026-03-28 09:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028
2026-03-28 09:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028
2026-03-28 09:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028 to the API
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:14:06Z',
 'fuel_type': 'diesel',
 'id': '6047d389-5c8a-5622-932a-8e15f5c7aa4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US24028',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 211228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-06',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2019}
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US24028%27 HTTP/1.1" 200 None
2026-03-28 09:09:56 [auto1.it] INFO: Saving data for US24028: {'auction_closing_time': 1774714446.0, 'created_time': 1774602440.169646, 'last_price_update_time': 1774688996.205774}
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US24028') HTTP/1.1" 204 0
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: UX21158
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: GX75357
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX75357%27 HTTP/1.1" 200 None
2026-03-28 09:09:56 [auto1.it] INFO: Scrape type for GX75357: 2
2026-03-28 09:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ff769d2-2722-5414-9155-4e41a4aa7c63 with identifier: GX75357
2026-03-28 09:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff769d2-2722-5414-9155-4e41a4aa7c63 with scrape type 2
2026-03-28 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ff769d2-2722-5414-9155-4e41a4aa7c63 with scrape type 2
2026-03-28 09:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ff769d2-2722-5414-9155-4e41a4aa7c63, identifier: GX75357
2026-03-28 09:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ff769d2-2722-5414-9155-4e41a4aa7c63 with identifier: GX75357
2026-03-28 09:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ff769d2-2722-5414-9155-4e41a4aa7c63 with identifier: GX75357
2026-03-28 09:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ff769d2-2722-5414-9155-4e41a4aa7c63 with identifier: GX75357 to the API
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:21Z',
 'fuel_type': 'diesel',
 'id': '6ff769d2-2722-5414-9155-4e41a4aa7c63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX75357',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 299028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX75357%27 HTTP/1.1" 200 None
2026-03-28 09:09:56 [auto1.it] INFO: Saving data for GX75357: {'auction_closing_time': 1774716261.0, 'created_time': 1774602418.703988, 'last_price_update_time': 1774688996.563027}
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX75357') HTTP/1.1" 204 0
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: AR78219
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: DA37611
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD48805%27 HTTP/1.1" 200 None
2026-03-28 09:09:56 [auto1.it] INFO: Scrape type for LD48805: 2
2026-03-28 09:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805
2026-03-28 09:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with scrape type 2
2026-03-28 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with scrape type 2
2026-03-28 09:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b, identifier: LD48805
2026-03-28 09:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805
2026-03-28 09:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805
2026-03-28 09:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805 to the API
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:31Z',
 'fuel_type': 'diesel',
 'id': 'ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD48805',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 169245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2016}
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD48805%27 HTTP/1.1" 200 None
2026-03-28 09:09:56 [auto1.it] INFO: Saving data for LD48805: {'auction_closing_time': 1774714591.0, 'created_time': 1772309276.607462, 'last_price_update_time': 1774688996.951978}
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD48805') HTTP/1.1" 204 0
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: RA37062
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: CJ01668
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ01668%27 HTTP/1.1" 200 None
2026-03-28 09:09:56 [auto1.it] INFO: Scrape type for CJ01668: 0
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-28 09:09:56 [auto1.it] INFO: Found listing with ID: NY40947
2026-03-28 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY40947%27 HTTP/1.1" 200 None
2026-03-28 09:09:57 [auto1.it] INFO: Scrape type for NY40947: 0
2026-03-28 09:09:57 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB11724%27 HTTP/1.1" 200 None
2026-03-28 09:09:57 [auto1.it] INFO: Scrape type for EB11724: 2
2026-03-28 09:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724
2026-03-28 09:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e3100f-6160-52ed-8db5-1af0712a88e8 with scrape type 2
2026-03-28 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3e3100f-6160-52ed-8db5-1af0712a88e8 with scrape type 2
2026-03-28 09:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3e3100f-6160-52ed-8db5-1af0712a88e8, identifier: EB11724
2026-03-28 09:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724
2026-03-28 09:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724
2026-03-28 09:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724 to the API
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:09:07Z',
 'fuel_type': 'diesel',
 'id': 'd3e3100f-6160-52ed-8db5-1af0712a88e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB11724',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 138333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-30',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2015}
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB11724%27 HTTP/1.1" 200 None
2026-03-28 09:09:57 [auto1.it] INFO: Saving data for EB11724: {'auction_closing_time': 1774714147.0, 'created_time': 1773131460.557116, 'last_price_update_time': 1774688997.377838}
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EB11724') HTTP/1.1" 204 0
2026-03-28 09:09:57 [auto1.it] INFO: Found listing with ID: BP64052
2026-03-28 09:09:57 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ20772%27 HTTP/1.1" 200 None
2026-03-28 09:09:57 [auto1.it] INFO: Scrape type for TJ20772: 2
2026-03-28 09:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772
2026-03-28 09:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with scrape type 2
2026-03-28 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with scrape type 2
2026-03-28 09:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a, identifier: TJ20772
2026-03-28 09:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772
2026-03-28 09:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772
2026-03-28 09:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772 to the API
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:11Z',
 'fuel_type': 'diesel',
 'id': 'e3c4b75d-fea7-595c-ae84-2925ccc6cb9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ20772',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 80017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-05',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Energy Grand Business Edition',
 'transmission': 'automatic',
 'trim': 'Grand Business Edition',
 'year': 2018}
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ20772%27 HTTP/1.1" 200 None
2026-03-28 09:09:57 [auto1.it] INFO: Saving data for TJ20772: {'auction_closing_time': 1774714691.0, 'created_time': 1774602417.806159, 'last_price_update_time': 1774688997.844317}
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ20772') HTTP/1.1" 204 0
2026-03-28 09:09:57 [auto1.it] INFO: Channel: 24h | Page: 86 | totalHits: 3444 | hits on page: 40
2026-03-28 09:09:57 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS54948%27 HTTP/1.1" 200 None
2026-03-28 09:09:57 [auto1.it] INFO: Scrape type for RS54948: 2
2026-03-28 09:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948
2026-03-28 09:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e830d0c2-62f4-5eff-a11a-65dad054cb64 with scrape type 2
2026-03-28 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e830d0c2-62f4-5eff-a11a-65dad054cb64 with scrape type 2
2026-03-28 09:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e830d0c2-62f4-5eff-a11a-65dad054cb64, identifier: RS54948
2026-03-28 09:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948
2026-03-28 09:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948
2026-03-28 09:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948 to the API
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:13:50Z',
 'fuel_type': 'petrol',
 'id': 'e830d0c2-62f4-5eff-a11a-65dad054cb64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS54948',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 183194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2010}
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS54948%27 HTTP/1.1" 200 None
2026-03-28 09:09:58 [auto1.it] INFO: Saving data for RS54948: {'auction_closing_time': 1774714430.0, 'created_time': 1772104608.628115, 'last_price_update_time': 1774688998.249597}
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RS54948') HTTP/1.1" 204 0
2026-03-28 09:09:58 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV19228%27 HTTP/1.1" 200 None
2026-03-28 09:09:58 [auto1.it] INFO: Scrape type for EV19228: 2
2026-03-28 09:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228
2026-03-28 09:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with scrape type 2
2026-03-28 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with scrape type 2
2026-03-28 09:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad, identifier: EV19228
2026-03-28 09:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:09:58 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-28 09:09:58 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-28 09:09:58 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-28 09:09:58 [auto1.it] INFO: Found listing with ID: WR61044
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR61044%27 HTTP/1.1" 200 None
2026-03-28 09:09:58 [auto1.it] INFO: Scrape type for WR61044: 2
2026-03-28 09:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb4b9003-75b7-5269-83c1-fbb4c3f61f52 with identifier: WR61044
2026-03-28 09:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb4b9003-75b7-5269-83c1-fbb4c3f61f52 with scrape type 2
2026-03-28 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb4b9003-75b7-5269-83c1-fbb4c3f61f52 with scrape type 2
2026-03-28 09:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb4b9003-75b7-5269-83c1-fbb4c3f61f52, identifier: WR61044
2026-03-28 09:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228
2026-03-28 09:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228
2026-03-28 09:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228 to the API
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:53:49Z',
 'fuel_type': 'petrol',
 'id': 'fbc3ba1a-3c99-55da-a6f5-35f88dc683ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV19228',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 16306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-16',
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV19228%27 HTTP/1.1" 200 None
2026-03-28 09:09:58 [auto1.it] INFO: Saving data for EV19228: {'auction_closing_time': 1774716829.0, 'created_time': 1772779429.759289, 'last_price_update_time': 1774688998.736052}
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV19228') HTTP/1.1" 204 0
2026-03-28 09:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb4b9003-75b7-5269-83c1-fbb4c3f61f52 with identifier: WR61044
2026-03-28 09:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb4b9003-75b7-5269-83c1-fbb4c3f61f52 with identifier: WR61044
2026-03-28 09:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb4b9003-75b7-5269-83c1-fbb4c3f61f52 with identifier: WR61044 to the API
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:46:55Z',
 'fuel_type': 'hybrid',
 'id': 'cb4b9003-75b7-5269-83c1-fbb4c3f61f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR61044',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 145972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active',
 'transmission': 'automatic',
 'trim': '2WD Active',
 'year': 2023}
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR61044%27 HTTP/1.1" 200 None
2026-03-28 09:09:58 [auto1.it] INFO: Saving data for WR61044: {'auction_closing_time': 1774716415.0, 'created_time': 1774440452.384692, 'last_price_update_time': 1774688998.991508}
2026-03-28 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR61044') HTTP/1.1" 204 0
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM88416%27 HTTP/1.1" 200 None
2026-03-28 09:09:59 [auto1.it] INFO: Scrape type for RM88416: 0
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV39349%27 HTTP/1.1" 200 None
2026-03-28 09:09:59 [auto1.it] INFO: Scrape type for XV39349: 2
2026-03-28 09:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349
2026-03-28 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd34ef04-e55b-5ce2-8030-511175269cc1 with scrape type 2
2026-03-28 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd34ef04-e55b-5ce2-8030-511175269cc1 with scrape type 2
2026-03-28 09:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd34ef04-e55b-5ce2-8030-511175269cc1, identifier: XV39349
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN19530%27 HTTP/1.1" 200 None
2026-03-28 09:09:59 [auto1.it] INFO: Scrape type for JN19530: 2
2026-03-28 09:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530
2026-03-28 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a021abbc-8973-5ffb-89a0-49e5b59705a9 with scrape type 2
2026-03-28 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a021abbc-8973-5ffb-89a0-49e5b59705a9 with scrape type 2
2026-03-28 09:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a021abbc-8973-5ffb-89a0-49e5b59705a9, identifier: JN19530
2026-03-28 09:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349
2026-03-28 09:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349
2026-03-28 09:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349 to the API
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:08Z',
 'fuel_type': 'diesel',
 'id': 'cd34ef04-e55b-5ce2-8030-511175269cc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV39349',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 259133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV39349%27 HTTP/1.1" 200 None
2026-03-28 09:09:59 [auto1.it] INFO: Saving data for XV39349: {'auction_closing_time': 1774714328.0, 'created_time': 1772272849.486534, 'last_price_update_time': 1774688999.480026}
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV39349') HTTP/1.1" 204 0
2026-03-28 09:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530
2026-03-28 09:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530
2026-03-28 09:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530 to the API
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:13:06Z',
 'fuel_type': 'diesel',
 'id': 'a021abbc-8973-5ffb-89a0-49e5b59705a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN19530',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 202249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-17',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Cool 2WD',
 'transmission': 'manual',
 'trim': 'Cool 2WD',
 'year': 2013}
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN19530%27 HTTP/1.1" 200 None
2026-03-28 09:09:59 [auto1.it] INFO: Saving data for JN19530: {'auction_closing_time': 1774714386.0, 'created_time': 1772747088.241957, 'last_price_update_time': 1774688999.85181}
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN19530') HTTP/1.1" 204 0
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN53386%27 HTTP/1.1" 200 None
2026-03-28 09:09:59 [auto1.it] INFO: Scrape type for EN53386: 2
2026-03-28 09:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386
2026-03-28 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f01568-8747-5387-998b-e62d0c10c17e with scrape type 2
2026-03-28 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f01568-8747-5387-998b-e62d0c10c17e with scrape type 2
2026-03-28 09:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26f01568-8747-5387-998b-e62d0c10c17e, identifier: EN53386
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-28 09:09:59 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY37168%27 HTTP/1.1" 200 None
2026-03-28 09:09:59 [auto1.it] INFO: Scrape type for YY37168: 2
2026-03-28 09:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168
2026-03-28 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6725802a-3980-53d9-a51e-2c8b76fcfc53 with scrape type 2
2026-03-28 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6725802a-3980-53d9-a51e-2c8b76fcfc53 with scrape type 2
2026-03-28 09:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6725802a-3980-53d9-a51e-2c8b76fcfc53, identifier: YY37168
2026-03-28 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386
2026-03-28 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386
2026-03-28 09:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386 to the API
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:48:12Z',
 'fuel_type': 'diesel',
 'id': '26f01568-8747-5387-998b-e62d0c10c17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN53386',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 115568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN53386%27 HTTP/1.1" 200 None
2026-03-28 09:10:00 [auto1.it] INFO: Saving data for EN53386: {'auction_closing_time': 1774716492.0, 'created_time': 1772532113.089021, 'last_price_update_time': 1774689000.37325}
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN53386') HTTP/1.1" 204 0
2026-03-28 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168
2026-03-28 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168
2026-03-28 09:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168 to the API
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:02:31Z',
 'fuel_type': 'petrol',
 'id': '6725802a-3980-53d9-a51e-2c8b76fcfc53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY37168',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 226131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-29',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY37168%27 HTTP/1.1" 200 None
2026-03-28 09:10:00 [auto1.it] INFO: Saving data for YY37168: {'auction_closing_time': 1774713751.0, 'created_time': 1774602442.2122, 'last_price_update_time': 1774689000.618045}
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY37168') HTTP/1.1" 204 0
2026-03-28 09:10:00 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-28 09:10:00 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU21728%27 HTTP/1.1" 200 None
2026-03-28 09:10:00 [auto1.it] INFO: Scrape type for JU21728: 2
2026-03-28 09:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728
2026-03-28 09:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with scrape type 2
2026-03-28 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with scrape type 2
2026-03-28 09:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1, identifier: JU21728
2026-03-28 09:10:00 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-28 09:10:00 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN14128%27 HTTP/1.1" 200 None
2026-03-28 09:10:00 [auto1.it] INFO: Scrape type for ZN14128: 2
2026-03-28 09:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128
2026-03-28 09:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90720bc8-dd16-555f-8199-27658e3d195e with scrape type 2
2026-03-28 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90720bc8-dd16-555f-8199-27658e3d195e with scrape type 2
2026-03-28 09:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90720bc8-dd16-555f-8199-27658e3d195e, identifier: ZN14128
2026-03-28 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728
2026-03-28 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728
2026-03-28 09:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728 to the API
2026-03-28 09:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:34:41Z',
 'fuel_type': 'diesel',
 'id': '26f996c9-9f8b-5fd5-a798-072e6c16fcd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU21728',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 94636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-28',
 'seller_name': None,
 'title': 'BMW 1er 114d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU21728%27 HTTP/1.1" 200 None
2026-03-28 09:10:01 [auto1.it] INFO: Saving data for JU21728: {'auction_closing_time': 1774715681.0, 'created_time': 1774602414.823306, 'last_price_update_time': 1774689001.116878}
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU21728') HTTP/1.1" 204 0
2026-03-28 09:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128
2026-03-28 09:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128
2026-03-28 09:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128 to the API
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:09:28Z',
 'fuel_type': 'diesel',
 'id': '90720bc8-dd16-555f-8199-27658e3d195e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN14128',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 130907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-24',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Xprime ISG 2WD',
 'transmission': 'manual',
 'trim': 'Xprime ISG 2WD',
 'year': 2019}
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN14128%27 HTTP/1.1" 200 None
2026-03-28 09:10:01 [auto1.it] INFO: Saving data for ZN14128: {'auction_closing_time': 1774714168.0, 'created_time': 1774602428.848675, 'last_price_update_time': 1774689001.496136}
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZN14128') HTTP/1.1" 204 0
2026-03-28 09:10:01 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG06778%27 HTTP/1.1" 200 None
2026-03-28 09:10:01 [auto1.it] INFO: Scrape type for RG06778: 2
2026-03-28 09:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778
2026-03-28 09:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0845609f-0d61-505f-8658-da37744a5288 with scrape type 2
2026-03-28 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0845609f-0d61-505f-8658-da37744a5288 with scrape type 2
2026-03-28 09:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0845609f-0d61-505f-8658-da37744a5288, identifier: RG06778
2026-03-28 09:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778
2026-03-28 09:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778
2026-03-28 09:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778 to the API
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:35:20Z',
 'fuel_type': 'diesel',
 'id': '0845609f-0d61-505f-8658-da37744a5288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG06778',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 221864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-10',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG06778%27 HTTP/1.1" 200 None
2026-03-28 09:10:01 [auto1.it] INFO: Saving data for RG06778: {'auction_closing_time': 1774715720.0, 'created_time': 1774602424.154842, 'last_price_update_time': 1774689001.947614}
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG06778') HTTP/1.1" 204 0
2026-03-28 09:10:01 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-28 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW53472%27 HTTP/1.1" 200 None
2026-03-28 09:10:02 [auto1.it] INFO: Scrape type for YW53472: 2
2026-03-28 09:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472
2026-03-28 09:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c87ba82-2f90-517f-90c2-3889c035945b with scrape type 2
2026-03-28 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c87ba82-2f90-517f-90c2-3889c035945b with scrape type 2
2026-03-28 09:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c87ba82-2f90-517f-90c2-3889c035945b, identifier: YW53472
2026-03-28 09:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472
2026-03-28 09:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472
2026-03-28 09:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472 to the API
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:00:20Z',
 'fuel_type': 'diesel',
 'id': '2c87ba82-2f90-517f-90c2-3889c035945b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW53472',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 223174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW53472%27 HTTP/1.1" 200 None
2026-03-28 09:10:02 [auto1.it] INFO: Saving data for YW53472: {'auction_closing_time': 1774713620.0, 'created_time': 1772176809.531559, 'last_price_update_time': 1774689002.370704}
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW53472') HTTP/1.1" 204 0
2026-03-28 09:10:02 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-28 09:10:02 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-28 09:10:02 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-28 09:10:02 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD87590%27 HTTP/1.1" 200 None
2026-03-28 09:10:02 [auto1.it] INFO: Scrape type for KD87590: 2
2026-03-28 09:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-03-28 09:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a44fbf-633a-5696-a4d4-d3398573fc86 with scrape type 2
2026-03-28 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68a44fbf-633a-5696-a4d4-d3398573fc86 with scrape type 2
2026-03-28 09:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 68a44fbf-633a-5696-a4d4-d3398573fc86, identifier: KD87590
2026-03-28 09:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-03-28 09:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-03-28 09:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590 to the API
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:15:27Z',
 'fuel_type': 'diesel',
 'id': '68a44fbf-633a-5696-a4d4-d3398573fc86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD87590',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 241530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-09',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD87590%27 HTTP/1.1" 200 None
2026-03-28 09:10:02 [auto1.it] INFO: Saving data for KD87590: {'auction_closing_time': 1774714527.0, 'created_time': 1774602423.727793, 'last_price_update_time': 1774689002.758933}
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KD87590') HTTP/1.1" 204 0
2026-03-28 09:10:02 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD38619%27 HTTP/1.1" 200 None
2026-03-28 09:10:02 [auto1.it] INFO: Scrape type for TD38619: 2
2026-03-28 09:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619
2026-03-28 09:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with scrape type 2
2026-03-28 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with scrape type 2
2026-03-28 09:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac, identifier: TD38619
2026-03-28 09:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619
2026-03-28 09:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619
2026-03-28 09:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619 to the API
2026-03-28 09:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:37:30Z',
 'fuel_type': 'petrol',
 'id': '704da0cc-ab15-5eb4-b0a6-55870eb5ddac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD38619',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 276319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2013}
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD38619%27 HTTP/1.1" 200 None
2026-03-28 09:10:03 [auto1.it] INFO: Saving data for TD38619: {'auction_closing_time': 1774715850.0, 'created_time': 1773131418.352694, 'last_price_update_time': 1774689003.153395}
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD38619') HTTP/1.1" 204 0
2026-03-28 09:10:03 [auto1.it] INFO: Found listing with ID: XC14615
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC14615%27 HTTP/1.1" 200 None
2026-03-28 09:10:03 [auto1.it] INFO: Scrape type for XC14615: 2
2026-03-28 09:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ba8b1a-10b2-528e-893b-351f1838f00e with identifier: XC14615
2026-03-28 09:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8ba8b1a-10b2-528e-893b-351f1838f00e with scrape type 2
2026-03-28 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8ba8b1a-10b2-528e-893b-351f1838f00e with scrape type 2
2026-03-28 09:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8ba8b1a-10b2-528e-893b-351f1838f00e, identifier: XC14615
2026-03-28 09:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8ba8b1a-10b2-528e-893b-351f1838f00e with identifier: XC14615
2026-03-28 09:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8ba8b1a-10b2-528e-893b-351f1838f00e with identifier: XC14615
2026-03-28 09:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b8ba8b1a-10b2-528e-893b-351f1838f00e with identifier: XC14615 to the API
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:12:04Z',
 'fuel_type': 'diesel',
 'id': 'b8ba8b1a-10b2-528e-893b-351f1838f00e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC14615',
 'listing': 'auction',
 'make': 'BMW',
 'model': '8er',
 'odometer': 118833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seller_name': None,
 'title': 'BMW 8er 840d Gran Coupe Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC14615%27 HTTP/1.1" 200 None
2026-03-28 09:10:03 [auto1.it] INFO: Saving data for XC14615: {'auction_closing_time': 1774714324.0, 'created_time': 1774447575.451262, 'last_price_update_time': 1774689003.52009}
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC14615') HTTP/1.1" 204 0
2026-03-28 09:10:03 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH24600%27 HTTP/1.1" 200 None
2026-03-28 09:10:03 [auto1.it] INFO: Scrape type for TH24600: 2
2026-03-28 09:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600
2026-03-28 09:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca9ca275-baad-5b60-ad8a-dafe4b1895af with scrape type 2
2026-03-28 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca9ca275-baad-5b60-ad8a-dafe4b1895af with scrape type 2
2026-03-28 09:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca9ca275-baad-5b60-ad8a-dafe4b1895af, identifier: TH24600
2026-03-28 09:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600
2026-03-28 09:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600
2026-03-28 09:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600 to the API
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:49:55Z',
 'fuel_type': 'diesel',
 'id': 'ca9ca275-baad-5b60-ad8a-dafe4b1895af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH24600',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 260831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH24600%27 HTTP/1.1" 200 None
2026-03-28 09:10:03 [auto1.it] INFO: Saving data for TH24600: {'auction_closing_time': 1774716595.0, 'created_time': 1772308886.418147, 'last_price_update_time': 1774689003.899043}
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH24600') HTTP/1.1" 204 0
2026-03-28 09:10:03 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59173%27 HTTP/1.1" 200 None
2026-03-28 09:10:03 [auto1.it] INFO: Scrape type for PV59173: 2
2026-03-28 09:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173
2026-03-28 09:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with scrape type 2
2026-03-28 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with scrape type 2
2026-03-28 09:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745, identifier: PV59173
2026-03-28 09:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173
2026-03-28 09:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173
2026-03-28 09:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173 to the API
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:23:58Z',
 'fuel_type': 'petrol',
 'id': '6b039a2d-05ac-51c8-89f1-fe6a97fd5745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV59173',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 137881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-29',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Desir',
 'transmission': 'manual',
 'trim': 'Desir',
 'year': 2010}
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59173%27 HTTP/1.1" 200 None
2026-03-28 09:10:04 [auto1.it] INFO: Saving data for PV59173: {'auction_closing_time': 1774715038.0, 'created_time': 1773304737.617318, 'last_price_update_time': 1774689004.283121}
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV59173') HTTP/1.1" 204 0
2026-03-28 09:10:04 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-28 09:10:04 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY69981%27 HTTP/1.1" 200 None
2026-03-28 09:10:04 [auto1.it] INFO: Scrape type for KY69981: 0
2026-03-28 09:10:04 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-28 09:10:04 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC73163%27 HTTP/1.1" 200 None
2026-03-28 09:10:04 [auto1.it] INFO: Scrape type for KC73163: 2
2026-03-28 09:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-03-28 09:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with scrape type 2
2026-03-28 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with scrape type 2
2026-03-28 09:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd, identifier: KC73163
2026-03-28 09:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-03-28 09:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-03-28 09:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163 to the API
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:34Z',
 'fuel_type': 'diesel',
 'id': '0b2ea67f-529f-589e-9934-ca76b4f4b9dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC73163',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 181099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-09',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2013}
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC73163%27 HTTP/1.1" 200 None
2026-03-28 09:10:04 [auto1.it] INFO: Saving data for KC73163: {'auction_closing_time': 1774717114.0, 'created_time': 1774602437.765037, 'last_price_update_time': 1774689004.691436}
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC73163') HTTP/1.1" 204 0
2026-03-28 09:10:04 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC28590%27 HTTP/1.1" 200 None
2026-03-28 09:10:04 [auto1.it] INFO: Scrape type for GC28590: 2
2026-03-28 09:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590
2026-03-28 09:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9380dd8-4869-57e4-a278-120a1961d0bd with scrape type 2
2026-03-28 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9380dd8-4869-57e4-a278-120a1961d0bd with scrape type 2
2026-03-28 09:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9380dd8-4869-57e4-a278-120a1961d0bd, identifier: GC28590
2026-03-28 09:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590
2026-03-28 09:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590
2026-03-28 09:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590 to the API
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:36:23Z',
 'fuel_type': 'hybrid',
 'id': 'a9380dd8-4869-57e4-a278-120a1961d0bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC28590',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 66685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC28590%27 HTTP/1.1" 200 None
2026-03-28 09:10:05 [auto1.it] INFO: Saving data for GC28590: {'auction_closing_time': 1774715783.0, 'created_time': 1773130637.903386, 'last_price_update_time': 1774689005.202597}
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC28590') HTTP/1.1" 204 0
2026-03-28 09:10:05 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH97251%27 HTTP/1.1" 200 None
2026-03-28 09:10:05 [auto1.it] INFO: Scrape type for LH97251: 2
2026-03-28 09:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251
2026-03-28 09:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630ae49b-afad-5af3-8703-54baf3133fb7 with scrape type 2
2026-03-28 09:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 630ae49b-afad-5af3-8703-54baf3133fb7 with scrape type 2
2026-03-28 09:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 630ae49b-afad-5af3-8703-54baf3133fb7, identifier: LH97251
2026-03-28 09:10:05 [scrapy.extensions.logstats] INFO: Crawled 226 pages (at 17 pages/min), scraped 258 items (at 103 items/min)
2026-03-28 09:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 208MiB
2026-03-28 09:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251
2026-03-28 09:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251
2026-03-28 09:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251 to the API
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:17Z',
 'fuel_type': 'petrol',
 'id': '630ae49b-afad-5af3-8703-54baf3133fb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH97251',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 36716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH97251%27 HTTP/1.1" 200 None
2026-03-28 09:10:05 [auto1.it] INFO: Saving data for LH97251: {'auction_closing_time': 1774715957.0, 'created_time': 1773132373.708529, 'last_price_update_time': 1774689005.597212}
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LH97251') HTTP/1.1" 204 0
2026-03-28 09:10:05 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND06570%27 HTTP/1.1" 200 None
2026-03-28 09:10:05 [auto1.it] INFO: Scrape type for ND06570: 0
2026-03-28 09:10:05 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT76605%27 HTTP/1.1" 200 None
2026-03-28 09:10:05 [auto1.it] INFO: Scrape type for FT76605: 2
2026-03-28 09:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605
2026-03-28 09:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff2849b-894f-5c33-a81c-470838157e7b with scrape type 2
2026-03-28 09:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff2849b-894f-5c33-a81c-470838157e7b with scrape type 2
2026-03-28 09:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ff2849b-894f-5c33-a81c-470838157e7b, identifier: FT76605
2026-03-28 09:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605
2026-03-28 09:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605
2026-03-28 09:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605 to the API
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:21:24Z',
 'fuel_type': 'diesel',
 'id': '5ff2849b-894f-5c33-a81c-470838157e7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT76605',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 110287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2019}
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT76605%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Saving data for FT76605: {'auction_closing_time': 1774714884.0, 'created_time': 1773136059.512628, 'last_price_update_time': 1774689006.021508}
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT76605') HTTP/1.1" 204 0
2026-03-28 09:10:06 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT43750%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Scrape type for UT43750: 2
2026-03-28 09:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750
2026-03-28 09:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b4c8ff-417f-5670-9f77-29f5c91fd305 with scrape type 2
2026-03-28 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48b4c8ff-417f-5670-9f77-29f5c91fd305 with scrape type 2
2026-03-28 09:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 48b4c8ff-417f-5670-9f77-29f5c91fd305, identifier: UT43750
2026-03-28 09:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750
2026-03-28 09:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750
2026-03-28 09:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750 to the API
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:36:36Z',
 'fuel_type': 'petrol',
 'id': '48b4c8ff-417f-5670-9f77-29f5c91fd305',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT43750',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 108737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT43750%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Saving data for UT43750: {'auction_closing_time': 1774715796.0, 'created_time': 1773522493.995191, 'last_price_update_time': 1774689006.451306}
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT43750') HTTP/1.1" 204 0
2026-03-28 09:10:06 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ23741%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Scrape type for TZ23741: 0
2026-03-28 09:10:06 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR70375%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Scrape type for VR70375: 0
2026-03-28 09:10:06 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR03246%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Scrape type for RR03246: 2
2026-03-28 09:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246
2026-03-28 09:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d67696-6bb3-5230-acad-0bc1c92390cf with scrape type 2
2026-03-28 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44d67696-6bb3-5230-acad-0bc1c92390cf with scrape type 2
2026-03-28 09:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 44d67696-6bb3-5230-acad-0bc1c92390cf, identifier: RR03246
2026-03-28 09:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246
2026-03-28 09:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246
2026-03-28 09:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246 to the API
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:56:06Z',
 'fuel_type': 'diesel',
 'id': '44d67696-6bb3-5230-acad-0bc1c92390cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR03246',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 256662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-01',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR03246%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Saving data for RR03246: {'auction_closing_time': 1774716966.0, 'created_time': 1773132025.673629, 'last_price_update_time': 1774689006.871371}
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RR03246') HTTP/1.1" 204 0
2026-03-28 09:10:06 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM66429%27 HTTP/1.1" 200 None
2026-03-28 09:10:06 [auto1.it] INFO: Scrape type for ZM66429: 2
2026-03-28 09:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429
2026-03-28 09:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8391b99d-bff6-5ed4-8d8d-f141e338b44c with scrape type 2
2026-03-28 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8391b99d-bff6-5ed4-8d8d-f141e338b44c with scrape type 2
2026-03-28 09:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8391b99d-bff6-5ed4-8d8d-f141e338b44c, identifier: ZM66429
2026-03-28 09:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429
2026-03-28 09:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429
2026-03-28 09:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429 to the API
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:36:48Z',
 'fuel_type': 'diesel',
 'id': '8391b99d-bff6-5ed4-8d8d-f141e338b44c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM66429',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 179606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM66429%27 HTTP/1.1" 200 None
2026-03-28 09:10:07 [auto1.it] INFO: Saving data for ZM66429: {'auction_closing_time': 1774715808.0, 'created_time': 1773136060.453575, 'last_price_update_time': 1774689007.263547}
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM66429') HTTP/1.1" 204 0
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU69652%27 HTTP/1.1" 200 None
2026-03-28 09:10:07 [auto1.it] INFO: Scrape type for UU69652: 0
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL84548%27 HTTP/1.1" 200 None
2026-03-28 09:10:07 [auto1.it] INFO: Scrape type for SL84548: 2
2026-03-28 09:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548
2026-03-28 09:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e86d13e-8fdb-518e-baaa-502034ed19bc with scrape type 2
2026-03-28 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e86d13e-8fdb-518e-baaa-502034ed19bc with scrape type 2
2026-03-28 09:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e86d13e-8fdb-518e-baaa-502034ed19bc, identifier: SL84548
2026-03-28 09:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548
2026-03-28 09:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548
2026-03-28 09:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548 to the API
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:43Z',
 'fuel_type': 'gas',
 'id': '6e86d13e-8fdb-518e-baaa-502034ed19bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL84548',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 147082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-29',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Benzin / LPG Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL84548%27 HTTP/1.1" 200 None
2026-03-28 09:10:07 [auto1.it] INFO: Saving data for SL84548: {'auction_closing_time': 1774714543.0, 'created_time': 1774602427.945628, 'last_price_update_time': 1774689007.662477}
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SL84548') HTTP/1.1" 204 0
2026-03-28 09:10:07 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-28 09:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:10:33 [auto1.it] INFO: Channel: 24h | Page: 87 | totalHits: 3445 | hits on page: 5
2026-03-28 09:10:33 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-28 09:10:33 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA45330%27 HTTP/1.1" 200 None
2026-03-28 09:10:33 [auto1.it] INFO: Scrape type for GA45330: 0
2026-03-28 09:10:33 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG22478%27 HTTP/1.1" 200 None
2026-03-28 09:10:33 [auto1.it] INFO: Scrape type for FG22478: 2
2026-03-28 09:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478
2026-03-28 09:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69047d-8b87-5ff9-a232-8eb082429c50 with scrape type 2
2026-03-28 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba69047d-8b87-5ff9-a232-8eb082429c50 with scrape type 2
2026-03-28 09:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba69047d-8b87-5ff9-a232-8eb082429c50, identifier: FG22478
2026-03-28 09:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478
2026-03-28 09:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478
2026-03-28 09:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478 to the API
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:03:43Z',
 'fuel_type': 'diesel',
 'id': 'ba69047d-8b87-5ff9-a232-8eb082429c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG22478',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 175367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG22478%27 HTTP/1.1" 200 None
2026-03-28 09:10:33 [auto1.it] INFO: Saving data for FG22478: {'auction_closing_time': 1774713823.0, 'created_time': 1772103851.508522, 'last_price_update_time': 1774689033.790288}
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FG22478') HTTP/1.1" 204 0
2026-03-28 09:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:10:33 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-28 09:10:33 [auto1.it] INFO: Found listing with ID: AU70551
2026-03-28 09:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:10:34 [auto1.it] INFO: Channel: 24h | Page: 88 | totalHits: 3445 | hits on page: 0
2026-03-28 09:10:34 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 09:10:34 [auto1.it] INFO: auto1.it Batch config: batch 2/2
2026-03-28 09:10:34 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1, <ScrapeType.BATCH_SKIPPED: 5>: 4}
2026-03-28 09:10:34 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (265 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_23_2026-03-28T09_05_00.jl
2026-03-28 09:10:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1158405,
 'downloader/request_count': 650,
 'downloader/request_method_count/GET': 560,
 'downloader/request_method_count/POST': 90,
 'downloader/response_bytes': 188791220,
 'downloader/response_count': 650,
 'downloader/response_status_count/200': 650,
 'dupefilter/filtered': 31,
 'elapsed_time_seconds': 329.641572,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 9, 10, 34, 805434, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 265,
 'log_count/DEBUG': 9273,
 'log_count/INFO': 10734,
 'memusage/max': 218497024,
 'memusage/startup': 149807104,
 'photo_download_count': 422,
 'request_depth_max': 91,
 'response_received_count': 228,
 'scheduler/dequeued': 650,
 'scheduler/dequeued/memory': 650,
 'scheduler/enqueued': 650,
 'scheduler/enqueued/memory': 650,
 'scrape_type/batch_skipped': 1709,
 'scrape_type/new': 68,
 'scrape_type/price_update': 197,
 'scrape_type/skipped': 1480,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 228,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.7690907598906125,
 'scrapy-zyte-api/mean_response_seconds': 2.8238449807670953,
 'scrapy-zyte-api/processed': 228,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 228,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 227,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 228,
 'scrapy-zyte-api/request_args/httpRequestBody': 90,
 'scrapy-zyte-api/request_args/httpRequestMethod': 90,
 'scrapy-zyte-api/request_args/httpResponseBody': 228,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 228,
 'scrapy-zyte-api/request_args/sessionContext': 228,
 'scrapy-zyte-api/request_args/url': 228,
 'scrapy-zyte-api/status_codes/200': 228,
 'scrapy-zyte-api/success': 228,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 3485,
 'source/total_available': 3445,
 'start_time': datetime.datetime(2026, 3, 28, 9, 5, 5, 163862, tzinfo=datetime.timezone.utc)}
2026-03-28 09:10:34 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 09:10:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9c0db5b410>
2026-03-28 09:10:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9c0d9ec490>

PROJECT (sourcing_v2), SPIDER (auto1.it)